-- Logs begin at Wed 2022-07-20 14:46:40 UTC, end at Wed 2022-07-20 15:46:22 UTC. -- Jul 20 15:14:03.602260 dv-cinder-848759-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 15:14:03.609759 dv-cinder-848759-3-smb devstack@keystone.service[80211]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 15:14:03 2022] *** Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: nodename: dv-cinder-848759-3-smb Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: machine: x86_64 Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: clock source: unix Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: pcre jit disabled Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: detected number of CPU cores: 4 Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: current working directory: / Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: detected binary path: /usr/bin/uwsgi-core Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: your processes number limit is 47680 Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: your memory page size is 4096 bytes Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: detected max file descriptor number: 2048 Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: lock engine: pthread robust mutexes Jul 20 15:14:03.613208 dv-cinder-848759-3-smb devstack@keystone.service[80211]: thunder lock: enabled Jul 20 15:14:03.614003 dv-cinder-848759-3-smb devstack@keystone.service[80211]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 15:14:03.614003 dv-cinder-848759-3-smb devstack@keystone.service[80211]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 15:14:03.657307 dv-cinder-848759-3-smb devstack@keystone.service[80211]: Python main interpreter initialized at 0x55c09e8519c0 Jul 20 15:14:03.657307 dv-cinder-848759-3-smb devstack@keystone.service[80211]: python threads support enabled Jul 20 15:14:03.657307 dv-cinder-848759-3-smb devstack@keystone.service[80211]: your server socket listen backlog is limited to 100 connections Jul 20 15:14:03.657307 dv-cinder-848759-3-smb devstack@keystone.service[80211]: your mercy for graceful operations on workers is 90 seconds Jul 20 15:14:03.657684 dv-cinder-848759-3-smb devstack@keystone.service[80211]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 15:14:03.657758 dv-cinder-848759-3-smb devstack@keystone.service[80211]: *** Operational MODE: preforking *** Jul 20 15:14:03.658010 dv-cinder-848759-3-smb devstack@keystone.service[80211]: *** uWSGI is running in multiple interpreter mode *** Jul 20 15:14:03.658010 dv-cinder-848759-3-smb devstack@keystone.service[80211]: spawned uWSGI master process (pid: 80211) Jul 20 15:14:03.658249 dv-cinder-848759-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 15:14:03.658781 dv-cinder-848759-3-smb devstack@keystone.service[80211]: spawned uWSGI worker 1 (pid: 80223, cores: 1) Jul 20 15:14:03.659148 dv-cinder-848759-3-smb devstack@keystone.service[80211]: spawned uWSGI worker 2 (pid: 80224, cores: 1) Jul 20 15:14:03.659290 dv-cinder-848759-3-smb devstack@keystone.service[80211]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 15:14:09.079323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:14:09.079323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: from cryptography.utils import int_from_bytes Jul 20 15:14:09.080158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:14:09.080158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: from cryptography.utils import int_from_bytes Jul 20 15:14:09.080594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:14:09.080594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: from cryptography.utils import int_from_bytes Jul 20 15:14:09.080716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:14:09.080716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: from cryptography.utils import int_from_bytes Jul 20 15:14:09.128831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 15:14:09.129018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 15:14:09.129218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] command line args: [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 15:14:09.129484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 15:14:09.129636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ================================================================================ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 15:14:09.129733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 15:14:09.129901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] admin_token = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.130002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 15:14:09.130142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] command line args: [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 15:14:09.130282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_dir = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.130282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.130417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 15:14:09.130484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] config_source = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.130548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ================================================================================ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 15:14:09.130610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] debug = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.130795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] admin_token = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.130894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] config_dir = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] config_source = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] debug = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.131851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_config_append = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_dir = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.132901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_config_append = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_dir = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.133848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134772 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.134902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.135084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.135167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.135338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.135461 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.135542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.135630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.135784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.135884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.136042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.136172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.136261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.136489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.136574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.136712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] publish_errors = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.136793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.136932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] publish_errors = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.137944 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] standard_threads = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138110 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_journal = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.138889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_json = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] standard_threads = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_stderr = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] use_syslog = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_journal = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.139875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.139955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_json = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.140089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.140172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_stderr = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.140259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] use_syslog = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.140338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.140496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:14:09.140579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.140753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.140835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.140987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.141077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.141233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.141317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.141463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.141547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.141703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.141794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.141939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142180 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.142985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.143144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.143239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.143377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.143459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.143603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.143746 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.143876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.144836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.145923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.146947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.147109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.147195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.147333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.147413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.147573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.147651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.147811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.147890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.148038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.148116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.148273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.148351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.148494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.148572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.148721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.148800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.149982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.150132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.150215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.150364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.150449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.150585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.150663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.150816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.150896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.151986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.152062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.152216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.152302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.152445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.152523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.152674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.152800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.152919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.153986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.154101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.154213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.154307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.154460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.154550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.154686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.154806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.154910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.155024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.155157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.155272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.155411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.155570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.155652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.155832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.155925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.156069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.156150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.156305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.156386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.156542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.156667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.156807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.156895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.157941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158176 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.158947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.159125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.159206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.159357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.159439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.159591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.159675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.159834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.159913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.160987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.161972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.162115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.162193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.162337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.162416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.162565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.162645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.162791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.162868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.163994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.164071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.164217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.external = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.164296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.164533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.164625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.164778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.164857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.external = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.password = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] auth.token = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.165932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.password = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.token = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.166959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.167131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.167211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.167359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.167451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.167601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.167682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.167861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.167958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.168067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.168198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.168282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.168356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.168515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.168598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.168743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.168836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.169965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.170044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.170203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.170291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.170454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.170535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.170709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.170787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.170987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.171151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.171255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.171387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.171509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.171619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.171763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.171851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.171998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.172080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.172234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.172314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.172480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.172571 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.172738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.172818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.172969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173288 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.173995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.174139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.174218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.174378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.174456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.174617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.174791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.174869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.174941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.175091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.175191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.175355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.175444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.175594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.175675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.175830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.175919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.176111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.176192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.176361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.176442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.176590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.176680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.176817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.176898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.177046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.177127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.177287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.177367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.177529 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.177611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.177771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.177850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.178014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.178099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.178253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.178334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.178502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.178581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.178737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.178816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.179981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.180162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.180242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.180398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.180480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.180635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.180715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.180859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.180944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.181104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.181200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.181346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.181436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.181571 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.181651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.181808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.181888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.182958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183209 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.183975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.184131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.184210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.184369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.184449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.184594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.184674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.184817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.184897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.185982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.186063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.186205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.186284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.186445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.186524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.186681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.186845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.186924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.187112 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.187193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.187355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.187447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.187597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.187678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.187837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.187917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.188986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.189998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.190158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.190243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.190397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.190477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.190621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.190713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.190861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.190942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.191118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.191198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.191349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.191427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.191580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.191662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.191809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.191895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.192976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.193981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.194133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.194212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.194365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.194445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.194591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.194671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.194820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.194900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.195074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.195156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.195312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.195391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.195549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.195634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.195835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.195919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.196080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.196161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.196316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.196395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.196546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.196627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.196828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.196916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.197928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] role.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] role.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198631 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.198948 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.199137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.199218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.199386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.199468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.199630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.199712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.199874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.199963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.200097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.200175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.200337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.200417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.200570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.200663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.200806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.200886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.201044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.201125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.201284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.201428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.201530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.201655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.201906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.201985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.202140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.202308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.202390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.202557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.202637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.202800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.202880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.203995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.204075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.204223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.204302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.204448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.204530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.204691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.204769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.204934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.205021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.205175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.205255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.205405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.205633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.205712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.205856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.205938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.206084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.206164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.206311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.206391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.206551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.206631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.206779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.206857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.207992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.208992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.209144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.209223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.209378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.209466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.209597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.209676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.209832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.209912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.210068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.210148 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.210310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.210390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.210598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.210688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.210838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.210918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.211094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.211188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.211354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.211435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.211586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.211666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.211815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.211903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.212969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.213990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.214121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.214202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.214356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.214436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.214583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.214670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.214746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 15:14:09.214819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.215080 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:14:09.215251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 15:14:09.246584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.246806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.247057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.249970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.250204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.250424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.255509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.258835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.283717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.283925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.284767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.284966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.431189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.431534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.479676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.479888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.480401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.480641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.543757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.544821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.545023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.545207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.569726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.569927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.570988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.571078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.571245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.571430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.582221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.582554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.595527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.595757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.595920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.596179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.596360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.596594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.596774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.599696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.599910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.600156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.600350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.600561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.600741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.600936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80224) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:14:09.614370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.614605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 15:14:09.614919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.615128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 15:14:09.615409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.615668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.615925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.616185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.616826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.617035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 15:14:09.617363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.617674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 15:14:09.617860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.618179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.618456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.618703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.628083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.628359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.628627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.628911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.633043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.633344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.633606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.633877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.637065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.640640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.640918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.641201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.641597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.641881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.642005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.642103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.642400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.642676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.642945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.643239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.643507 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.645131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.645410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.645682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.646067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.646343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.646600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.646870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.647166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.647432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.647703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.648011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.673831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.674419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.675462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.675744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.676201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.676475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.681071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.681347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.681633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.681758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.681989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.682264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.688918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.689204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.689651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.689925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.693826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.694112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.694392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.694518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.694622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.694702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.694922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.695071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.695229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.695324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.695484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.695616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.695817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.695900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.696084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.696346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.714746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.714871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.715039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.715125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.719712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.719838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.723320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.723448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.723579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.723683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.728604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.728997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.732433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.732643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.736125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.736414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.736539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.736690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.736818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.736943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.737084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.737215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.737352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.737507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.737599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.737771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.756795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.757162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.757286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.757434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.757579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.757711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.757834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.758062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.765706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.766150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.767417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.767684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.767872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.768171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.770699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.770993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.771255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.771382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.771531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.771681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.771778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.771858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.772064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.772347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.785233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.785499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.785775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.785913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.786056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.786138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.786270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.786499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.786621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.786763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.786890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.787095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.787221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.787519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.806110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.806850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.809452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.810140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.812916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.813479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.814513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.815103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.816157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.816411 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.816713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.816838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.816964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.817269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.824131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.824827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.825738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.826594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.829153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.829433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.829706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.829976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.830174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.830464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.830740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.831023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.839174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.839452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.839725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.840373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.840659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.840938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.847691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80224) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.847961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.848229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.848494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.848755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.848879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:14:09.849020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.849103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.849285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.849412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.849566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.849652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.849803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.849943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.850083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.850167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.850301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.850441 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.850521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.850643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.850805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.850932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.851071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80224) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.851158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.851434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.851706 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.852027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.852284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:14:09.889376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c09e8519c0 pid: 80224 (default app) Jul 20 15:14:09.890428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c09e8519c0 pid: 80223 (default app) Jul 20 15:14:09.892903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d64b3a-5c96-472e-8744-8f1229b68e82 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:09.893194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d64b3a-5c96-472e-8744-8f1229b68e82 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:09.893470 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d64b3a-5c96-472e-8744-8f1229b68e82 None None] PATH_INFO: `/v3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:09.897652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Wed Jul 20 15:14:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:17.580401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4f266-dc76-4415-9bdf-be6d3800aaae None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:17.581332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4f266-dc76-4415-9bdf-be6d3800aaae None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:17.581332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4f266-dc76-4415-9bdf-be6d3800aaae None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:17.587708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:17.593419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:17.593861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:17.593950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:17.663232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: INFO dbcounter [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] Registered counter for database keystone Jul 20 15:14:17.689432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG oslo_db.sqlalchemy.engines [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:14:17.701640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writer thread running {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:14:17.892306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG passlib.handlers.bcrypt [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80224) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 15:14:17.892678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG passlib.handlers.bcrypt [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80224) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 15:14:17.948144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:17.949777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:18.081773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 20 15:14:18.266239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4f266-dc76-4415-9bdf-be6d3800aaae None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:18.337510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: INFO dbcounter [None req-91a4f266-dc76-4415-9bdf-be6d3800aaae None None] Registered counter for database keystone Jul 20 15:14:18.358696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG oslo_db.sqlalchemy.engines [None req-91a4f266-dc76-4415-9bdf-be6d3800aaae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:14:18.370603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writer thread running {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:14:18.489669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4f266-dc76-4415-9bdf-be6d3800aaae None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:18.495710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0e9d8-590b-4fb8-92a6-e031027c6772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:18.496385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e9d8-590b-4fb8-92a6-e031027c6772 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:18.496662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e9d8-590b-4fb8-92a6-e031027c6772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:18.496935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e9d8-590b-4fb8-92a6-e031027c6772 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:18.506176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0e9d8-590b-4fb8-92a6-e031027c6772 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:18.557763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WARNING keystone.common.rbac_enforcer.enforcer [None req-40e0e9d8-590b-4fb8-92a6-e031027c6772 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 15:14:18.558026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0e9d8-590b-4fb8-92a6-e031027c6772 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:18.568459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Jul 20 15:14:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:14:18.574910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:18.590631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab29c27-067d-4cc7-aa35-97e340bf1a6f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:18.596312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e08d25-5a3c-4b7b-9273-e0eb25c88435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:18.597451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08d25-5a3c-4b7b-9273-e0eb25c88435 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:18.597737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08d25-5a3c-4b7b-9273-e0eb25c88435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:18.598008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08d25-5a3c-4b7b-9273-e0eb25c88435 admin admin] PATH_INFO: `/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:18.602313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e08d25-5a3c-4b7b-9273-e0eb25c88435 admin admin] RBAC: Authorizing `identity:get_project(project_id=c5f14ce4f34142fb8d7bb6b7280eba0a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:18.653170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00e08d25-5a3c-4b7b-9273-e0eb25c88435 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 15:14:18.653513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e08d25-5a3c-4b7b-9273-e0eb25c88435 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:18.658162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Wed Jul 20 15:14:18 2022] GET /identity/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:20.660071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7003-4055-4748-8655-a3603b5a96d6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:20.660964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7003-4055-4748-8655-a3603b5a96d6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:20.660964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7003-4055-4748-8655-a3603b5a96d6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:20.667733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:20.676784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4470532-a8b7-485b-ae59-d9e491de990b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:20.677212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4470532-a8b7-485b-ae59-d9e491de990b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:20.677357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4470532-a8b7-485b-ae59-d9e491de990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:20.699038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a4470532-a8b7-485b-ae59-d9e491de990b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:20.700593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a4470532-a8b7-485b-ae59-d9e491de990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:20.711564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 15:14:20.734515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7003-4055-4748-8655-a3603b5a96d6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:20.752065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7003-4055-4748-8655-a3603b5a96d6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:20.757176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a8dca-196a-474e-8e8f-735dbdeb0ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:20.757959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a8dca-196a-474e-8e8f-735dbdeb0ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:20.758249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a8dca-196a-474e-8e8f-735dbdeb0ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:20.758526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a8dca-196a-474e-8e8f-735dbdeb0ad8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:20.766543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a8dca-196a-474e-8e8f-735dbdeb0ad8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:20.768381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a8dca-196a-474e-8e8f-735dbdeb0ad8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:20.777281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Jul 20 15:14:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:14:20.783573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4470532-a8b7-485b-ae59-d9e491de990b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:20.798184 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4470532-a8b7-485b-ae59-d9e491de990b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:20.806657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd21b2-35e6-4fa0-8823-c0412e95ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:20.807571 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd21b2-35e6-4fa0-8823-c0412e95ad61 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:20.807852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd21b2-35e6-4fa0-8823-c0412e95ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:20.808125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd21b2-35e6-4fa0-8823-c0412e95ad61 admin admin] PATH_INFO: `/v3/users/aa2794a5a2cb463787b9e7bc82103b03` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:20.809744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd21b2-35e6-4fa0-8823-c0412e95ad61 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa2794a5a2cb463787b9e7bc82103b03)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:20.811655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd21b2-35e6-4fa0-8823-c0412e95ad61 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:20.813249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Wed Jul 20 15:14:20 2022] GET /identity/v3/users/aa2794a5a2cb463787b9e7bc82103b03 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:22.901434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa5551-59c8-44cc-94b4-d0b38584187f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:22.902023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa5551-59c8-44cc-94b4-d0b38584187f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:22.902023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa5551-59c8-44cc-94b4-d0b38584187f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:22.903621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:14:22.908598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b221d-f73d-4728-9959-c85f482a7277 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:22.909039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b221d-f73d-4728-9959-c85f482a7277 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:22.909122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b221d-f73d-4728-9959-c85f482a7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:22.922189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48164474-6d4f-4c4b-b8c3-dd03107aa7f4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:22.922565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48164474-6d4f-4c4b-b8c3-dd03107aa7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:22.922858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48164474-6d4f-4c4b-b8c3-dd03107aa7f4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:22.924252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:22.926243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bb1b221d-f73d-4728-9959-c85f482a7277 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:22.927470 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb1b221d-f73d-4728-9959-c85f482a7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:22.929179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:22.929503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:22.929904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:22.971721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG passlib.handlers.bcrypt [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80223) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 15:14:22.972146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG passlib.handlers.bcrypt [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80223) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 15:14:23.017381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:23.017920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:23.018992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:23.041276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b221d-f73d-4728-9959-c85f482a7277 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:23.067017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:23.123142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:23.145661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:23.148579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b221d-f73d-4728-9959-c85f482a7277 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:23.183392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f0c84-e1aa-4c14-9a0a-e0dd681f3271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:23.184129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0c84-e1aa-4c14-9a0a-e0dd681f3271 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:23.184405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0c84-e1aa-4c14-9a0a-e0dd681f3271 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:23.184677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0c84-e1aa-4c14-9a0a-e0dd681f3271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:23.196305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f0c84-e1aa-4c14-9a0a-e0dd681f3271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7b4f0c84-e1aa-4c14-9a0a-e0dd681f3271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:23.207614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:23.208692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:23.209495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:14:23.214752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f0c84-e1aa-4c14-9a0a-e0dd681f3271 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:23.248636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e36739-e550-4077-a9e9-59b03f110c11 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:23.250915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:23.285486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e50df3-ff50-46ba-8e76-a0601ef0fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:23.286394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e50df3-ff50-46ba-8e76-a0601ef0fbcd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:23.286682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e50df3-ff50-46ba-8e76-a0601ef0fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:23.286988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e50df3-ff50-46ba-8e76-a0601ef0fbcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:23.295450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:23.313496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f0c84-e1aa-4c14-9a0a-e0dd681f3271 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:23.352135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:23.352811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:23.352904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e50df3-ff50-46ba-8e76-a0601ef0fbcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:23.353091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:23.353363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:23.354124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:23.354406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e50df3-ff50-46ba-8e76-a0601ef0fbcd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:23.354496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:23.355876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:23.368862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:23.374956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:23.452410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:14:23.458595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e50df3-ff50-46ba-8e76-a0601ef0fbcd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:23.461706 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:23.474170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bf059-e80e-46f7-a54e-664145a31c08 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:23.508151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e13fe4-4fa9-46d0-bce9-ef6d514fda9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:23.509064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13fe4-4fa9-46d0-bce9-ef6d514fda9a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:23.509348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13fe4-4fa9-46d0-bce9-ef6d514fda9a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:23.509624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13fe4-4fa9-46d0-bce9-ef6d514fda9a None admin] PATH_INFO: `/v3/users/aa2794a5a2cb463787b9e7bc82103b03` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:23.510844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e13fe4-4fa9-46d0-bce9-ef6d514fda9a None admin] RBAC: Authorizing `identity:get_user(user_id=aa2794a5a2cb463787b9e7bc82103b03)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:23.512391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e13fe4-4fa9-46d0-bce9-ef6d514fda9a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:23.514049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:23 2022] GET /identity/v3/users/aa2794a5a2cb463787b9e7bc82103b03 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:23.519511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e13fe4-4fa9-46d0-bce9-ef6d514fda9a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:23.533526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:23.557869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e50df3-ff50-46ba-8e76-a0601ef0fbcd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:23.593038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:23.593846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:23.594129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:23.594405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:23.614454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:23.615980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:23.618646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e13fe4-4fa9-46d0-bce9-ef6d514fda9a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:14:23.636755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:23.637614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:23.638408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:14:23.638408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:14:23.638408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:14:23.638408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:23.638408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:23.643845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:23.652791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9da31d-3e02-4d14-826f-4f4018f30b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:23.653595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da31d-3e02-4d14-826f-4f4018f30b46 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:23.653874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da31d-3e02-4d14-826f-4f4018f30b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:23.654138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da31d-3e02-4d14-826f-4f4018f30b46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:23.655300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9da31d-3e02-4d14-826f-4f4018f30b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:23.656767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9da31d-3e02-4d14-826f-4f4018f30b46 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:23.658538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:23.664531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9da31d-3e02-4d14-826f-4f4018f30b46 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:23.699421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:23.742997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd205880-38ec-4cf7-903d-baf6235e6cc5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:23.743463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:23.764760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9da31d-3e02-4d14-826f-4f4018f30b46 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:23.776939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668dcf9-b65e-4ce3-80db-8a974425c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:23.777684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668dcf9-b65e-4ce3-80db-8a974425c836 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:23.777895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668dcf9-b65e-4ce3-80db-8a974425c836 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:23.778174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668dcf9-b65e-4ce3-80db-8a974425c836 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:23.778914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668dcf9-b65e-4ce3-80db-8a974425c836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:23.779247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668dcf9-b65e-4ce3-80db-8a974425c836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:23.780684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668dcf9-b65e-4ce3-80db-8a974425c836 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:23.797986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afb5c6-dd2b-47ab-898f-52a5868f7f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:23.798138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:23.798653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb5c6-dd2b-47ab-898f-52a5868f7f15 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:23.798936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb5c6-dd2b-47ab-898f-52a5868f7f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:23.799241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb5c6-dd2b-47ab-898f-52a5868f7f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:23.800075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afb5c6-dd2b-47ab-898f-52a5868f7f15 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.domain.id=default, user.id=aa2794a5a2cb463787b9e7bc82103b03) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:23.800387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afb5c6-dd2b-47ab-898f-52a5868f7f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:23.801862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afb5c6-dd2b-47ab-898f-52a5868f7f15 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:23.809572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Jul 20 15:14:23 2022] GET /identity/v3/role_assignments?user.id=aa2794a5a2cb463787b9e7bc82103b03&scope.domain.id=default&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:26.194742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99873-def2-4307-b816-455aaf957509 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.195338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99873-def2-4307-b816-455aaf957509 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.195517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99873-def2-4307-b816-455aaf957509 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.196816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:26.202156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7fedf-1a7c-4534-858f-65c1eda18a0c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.202598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7fedf-1a7c-4534-858f-65c1eda18a0c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.202774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7fedf-1a7c-4534-858f-65c1eda18a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.227108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a9c7fedf-1a7c-4534-858f-65c1eda18a0c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:26.228367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a9c7fedf-1a7c-4534-858f-65c1eda18a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:26.243213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5b79-d8ab-437f-b52c-ec55f8a268d8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.243796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5b79-d8ab-437f-b52c-ec55f8a268d8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.244283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5b79-d8ab-437f-b52c-ec55f8a268d8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.246220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 12/23] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:14:26.261323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381146-c082-401f-9752-12cfcc3d5fcf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.261875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381146-c082-401f-9752-12cfcc3d5fcf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.262357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24381146-c082-401f-9752-12cfcc3d5fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.285576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-24381146-c082-401f-9752-12cfcc3d5fcf None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:26.288692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-24381146-c082-401f-9752-12cfcc3d5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:26.375403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 12/24] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:26.376752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80fcc9-1f0d-4152-bf0d-b43b265de520 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.377040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80fcc9-1f0d-4152-bf0d-b43b265de520 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.377316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80fcc9-1f0d-4152-bf0d-b43b265de520 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.378603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 13/25] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:26.386492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe2b1-de6f-48c2-8015-d6d030f39de9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.386779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe2b1-de6f-48c2-8015-d6d030f39de9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.387077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe2b1-de6f-48c2-8015-d6d030f39de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.423803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ed5fe2b1-de6f-48c2-8015-d6d030f39de9 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:26.425007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed5fe2b1-de6f-48c2-8015-d6d030f39de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:26.429051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 13/26] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:26.429945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24381146-c082-401f-9752-12cfcc3d5fcf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:26.494500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:26.519926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 14/27] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:26.521273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54c0a-e688-480b-869f-a5568811d30f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.523177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54c0a-e688-480b-869f-a5568811d30f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.523497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a54c0a-e688-480b-869f-a5568811d30f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.524846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 15/28] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:26.525556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a54c0a-e688-480b-869f-a5568811d30f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:26.534991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:26.576281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24381146-c082-401f-9752-12cfcc3d5fcf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:26.623244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c298f4f-e7c1-479f-ada3-35169575bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:26.624512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c298f4f-e7c1-479f-ada3-35169575bf79 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.625056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c298f4f-e7c1-479f-ada3-35169575bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.625335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c298f4f-e7c1-479f-ada3-35169575bf79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.638552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c298f4f-e7c1-479f-ada3-35169575bf79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:26.639538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a54c0a-e688-480b-869f-a5568811d30f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:26.640207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c298f4f-e7c1-479f-ada3-35169575bf79 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6c298f4f-e7c1-479f-ada3-35169575bf79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:14:26.659343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:26.660175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:26.660954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:14:26.660954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:14:26.660954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:14:26.660954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:26.662977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 14/29] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:26.664431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a558c-1887-4358-97a8-669144975a77 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.664931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a558c-1887-4358-97a8-669144975a77 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.665406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a558c-1887-4358-97a8-669144975a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.682035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9810ec-01cb-4944-9a74-9e191bb1cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:26.682915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9810ec-01cb-4944-9a74-9e191bb1cafd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.683298 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9810ec-01cb-4944-9a74-9e191bb1cafd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.683630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9810ec-01cb-4944-9a74-9e191bb1cafd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.684252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b15a558c-1887-4358-97a8-669144975a77 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:26.685770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b15a558c-1887-4358-97a8-669144975a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:26.699275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9810ec-01cb-4944-9a74-9e191bb1cafd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4d9810ec-01cb-4944-9a74-9e191bb1cafd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:26.709027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:26.709893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:26.710624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 16/30] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:26.711867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9810ec-01cb-4944-9a74-9e191bb1cafd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:26.762305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 15/31] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:26.763616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a558c-1887-4358-97a8-669144975a77 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:26.788446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:26.793300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:26.827236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9810ec-01cb-4944-9a74-9e191bb1cafd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:26.866708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98bfc9-ac3d-42fb-85d5-87adb35ccb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:26.867849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98bfc9-ac3d-42fb-85d5-87adb35ccb37 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.868342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98bfc9-ac3d-42fb-85d5-87adb35ccb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.868808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98bfc9-ac3d-42fb-85d5-87adb35ccb37 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.870644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98bfc9-ac3d-42fb-85d5-87adb35ccb37 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:26.872738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98bfc9-ac3d-42fb-85d5-87adb35ccb37 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:26.883348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a558c-1887-4358-97a8-669144975a77 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:26.922576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:26.923322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:26.923649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:26.924009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:26.924799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:26.925177 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:26.926813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:26.941888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 16/32] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:26.941888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:27.023765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 17/33] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jul 20 15:14:26 2022] POST /identity/v3/roles => generated 225 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:27.024916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98bfc9-ac3d-42fb-85d5-87adb35ccb37 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:27.043761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:27.059550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0938f17-e9f6-4c26-8f97-679d9f7dcc66 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:27.102084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:27.103315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.103837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.104305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.105920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:27.106456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:27.108397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:27.123906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 17/34] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:27.125163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:27.245714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7fded-487f-4e63-b567-0ddfcdbca9a5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:27.294933 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98bfc9-ac3d-42fb-85d5-87adb35ccb37 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:27.298658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf908dc-4ef3-4bf8-8859-5074bfa5f07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:27.299614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf908dc-4ef3-4bf8-8859-5074bfa5f07c None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.300135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf908dc-4ef3-4bf8-8859-5074bfa5f07c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.301888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf908dc-4ef3-4bf8-8859-5074bfa5f07c None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.303593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf908dc-4ef3-4bf8-8859-5074bfa5f07c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:27.305774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf908dc-4ef3-4bf8-8859-5074bfa5f07c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:27.321779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:27.335759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8f40b-0e2b-4738-a29b-4b73e3581d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:27.336474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f40b-0e2b-4738-a29b-4b73e3581d5c None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.336760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f40b-0e2b-4738-a29b-4b73e3581d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.337043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f40b-0e2b-4738-a29b-4b73e3581d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.337809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8f40b-0e2b-4738-a29b-4b73e3581d5c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:27.340542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8f40b-0e2b-4738-a29b-4b73e3581d5c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:27.358117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 18/35] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jul 20 15:14:27 2022] POST /identity/v3/roles => generated 219 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:27.359541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8f40b-0e2b-4738-a29b-4b73e3581d5c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:27.455956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 18/36] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:14:27 2022] POST /identity/v3/projects => generated 301 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:27.485403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8f40b-0e2b-4738-a29b-4b73e3581d5c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:27.526486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e93a7-9cb9-4298-a6cb-29983737af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:27.527428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e93a7-9cb9-4298-a6cb-29983737af87 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.527712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e93a7-9cb9-4298-a6cb-29983737af87 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.527988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e93a7-9cb9-4298-a6cb-29983737af87 None admin] PATH_INFO: `/v3/users/aa2794a5a2cb463787b9e7bc82103b03` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.529347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e93a7-9cb9-4298-a6cb-29983737af87 None admin] RBAC: Authorizing `identity:get_user(user_id=aa2794a5a2cb463787b9e7bc82103b03)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:27.530903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e93a7-9cb9-4298-a6cb-29983737af87 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:27.532803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 19/37] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:27 2022] GET /identity/v3/users/aa2794a5a2cb463787b9e7bc82103b03 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:27.539068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf908dc-4ef3-4bf8-8859-5074bfa5f07c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:27.542403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:27.662106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf908dc-4ef3-4bf8-8859-5074bfa5f07c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:27.700475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d18c3d-6a44-4af2-987d-d45f6f2f2981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:27.701789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d18c3d-6a44-4af2-987d-d45f6f2f2981 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.702289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d18c3d-6a44-4af2-987d-d45f6f2f2981 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.702758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d18c3d-6a44-4af2-987d-d45f6f2f2981 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.704363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d18c3d-6a44-4af2-987d-d45f6f2f2981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:27.706172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d18c3d-6a44-4af2-987d-d45f6f2f2981 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:27.708125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 19/38] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:27.714330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e93a7-9cb9-4298-a6cb-29983737af87 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:27.733137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8ee96-102c-431f-94d1-d82c1e0c4355 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.733447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8ee96-102c-431f-94d1-d82c1e0c4355 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.733701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8ee96-102c-431f-94d1-d82c1e0c4355 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.735166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 20/39] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:14:27.741194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b6f56-b19c-4dad-9276-f8d3e045fa3e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.741969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b6f56-b19c-4dad-9276-f8d3e045fa3e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.742394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b6f56-b19c-4dad-9276-f8d3e045fa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.767653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6b6b6f56-b19c-4dad-9276-f8d3e045fa3e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:27.769197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6b6b6f56-b19c-4dad-9276-f8d3e045fa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:27.799339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:27.850578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:27.855925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e93a7-9cb9-4298-a6cb-29983737af87 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:27.863649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 21/40] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:27.879875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b6f56-b19c-4dad-9276-f8d3e045fa3e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:27.893206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6de8b-c4ae-4dda-960e-dc7a1d69b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:27.894583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6de8b-c4ae-4dda-960e-dc7a1d69b126 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.895081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6de8b-c4ae-4dda-960e-dc7a1d69b126 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.895992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6de8b-c4ae-4dda-960e-dc7a1d69b126 None admin] PATH_INFO: `/v3/domains/default/users/aa2794a5a2cb463787b9e7bc82103b03/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.899246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6de8b-c4ae-4dda-960e-dc7a1d69b126 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=aa2794a5a2cb463787b9e7bc82103b03, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:27.900936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6de8b-c4ae-4dda-960e-dc7a1d69b126 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:27.919959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 20/41] 10.222.0.47 () {58 vars in 1361 bytes} [Wed Jul 20 15:14:27 2022] PUT /identity/v3/domains/default/users/aa2794a5a2cb463787b9e7bc82103b03/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:14:27.960076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08642-5ccd-4b5c-9388-6a23ccbe89a9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.960433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08642-5ccd-4b5c-9388-6a23ccbe89a9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.961285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08642-5ccd-4b5c-9388-6a23ccbe89a9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.963002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 21/42] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:14:27.968490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e776-5654-4bba-b4f7-7abe71ee36b9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:27.968775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e776-5654-4bba-b4f7-7abe71ee36b9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:27.969057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e776-5654-4bba-b4f7-7abe71ee36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:27.986862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f613e776-5654-4bba-b4f7-7abe71ee36b9 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:27.988499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f613e776-5654-4bba-b4f7-7abe71ee36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:27.999576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b6f56-b19c-4dad-9276-f8d3e045fa3e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:28.038836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36049f91-c169-47f1-8411-439af2e2b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:28.039571 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36049f91-c169-47f1-8411-439af2e2b3ae None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:28.039857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36049f91-c169-47f1-8411-439af2e2b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:28.040137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36049f91-c169-47f1-8411-439af2e2b3ae None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:28.040916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36049f91-c169-47f1-8411-439af2e2b3ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:28.042372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36049f91-c169-47f1-8411-439af2e2b3ae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:28.059812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 22/43] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jul 20 15:14:27 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:14:28.064214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 22/44] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:28.087726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36049f91-c169-47f1-8411-439af2e2b3ae None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:28.165565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:28.218234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36049f91-c169-47f1-8411-439af2e2b3ae None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:28.258845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4900e-2eb1-441b-8805-c5ff48cfe7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:28.259786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4900e-2eb1-441b-8805-c5ff48cfe7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:28.260075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4900e-2eb1-441b-8805-c5ff48cfe7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:28.260354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4900e-2eb1-441b-8805-c5ff48cfe7b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:28.261589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4900e-2eb1-441b-8805-c5ff48cfe7b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:28.263103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4900e-2eb1-441b-8805-c5ff48cfe7b9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:28.264744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 23/45] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:28.270603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613e776-5654-4bba-b4f7-7abe71ee36b9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:28.314847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:28.372875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613e776-5654-4bba-b4f7-7abe71ee36b9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:28.520117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1d0ae-a054-4b03-a2a1-7fb3e1f2129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:28.520727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d0ae-a054-4b03-a2a1-7fb3e1f2129b None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:28.521017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d0ae-a054-4b03-a2a1-7fb3e1f2129b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:28.521284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d0ae-a054-4b03-a2a1-7fb3e1f2129b None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:28.522009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1d0ae-a054-4b03-a2a1-7fb3e1f2129b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:28.523554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1d0ae-a054-4b03-a2a1-7fb3e1f2129b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:28.551977 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:14:28 2022] POST /identity/v3/projects => generated 312 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:29.967616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7305-cfaf-42c0-8605-e860e84a3570 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:29.968244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7305-cfaf-42c0-8605-e860e84a3570 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:29.968244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7305-cfaf-42c0-8605-e860e84a3570 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:29.969627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 24/47] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:29.975054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed85f-3554-41b7-b3e1-11cc18872995 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:29.975487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed85f-3554-41b7-b3e1-11cc18872995 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:29.975570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed85f-3554-41b7-b3e1-11cc18872995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:29.993693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-61aed85f-3554-41b7-b3e1-11cc18872995 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:29.994906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-61aed85f-3554-41b7-b3e1-11cc18872995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:30.066038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 24/48] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:30.089340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7305-cfaf-42c0-8605-e860e84a3570 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:30.198743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7305-cfaf-42c0-8605-e860e84a3570 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:30.228002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:30.237954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa091-469a-4489-8c72-d6d8763af039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:30.238855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa091-469a-4489-8c72-d6d8763af039 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.239178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa091-469a-4489-8c72-d6d8763af039 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.239458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa091-469a-4489-8c72-d6d8763af039 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.252411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fa091-469a-4489-8c72-d6d8763af039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f14fa091-469a-4489-8c72-d6d8763af039 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:30.261334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:30.262165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:30.262917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 25/49] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:30.268650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aed85f-3554-41b7-b3e1-11cc18872995 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:30.294819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:30.371833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aed85f-3554-41b7-b3e1-11cc18872995 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:30.405980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9768610-9b1c-4623-8e00-5bdc5aba03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:30.406658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9768610-9b1c-4623-8e00-5bdc5aba03f2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.406941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9768610-9b1c-4623-8e00-5bdc5aba03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.407246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9768610-9b1c-4623-8e00-5bdc5aba03f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.407998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9768610-9b1c-4623-8e00-5bdc5aba03f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:30.408302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9768610-9b1c-4623-8e00-5bdc5aba03f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:30.409712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9768610-9b1c-4623-8e00-5bdc5aba03f2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:30.418073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 25/50] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:30.423643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa091-469a-4489-8c72-d6d8763af039 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:30.527965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa091-469a-4489-8c72-d6d8763af039 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:30.564590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a33f9-bfd4-405e-98af-c30502e52b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:30.565499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a33f9-bfd4-405e-98af-c30502e52b2f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.565784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a33f9-bfd4-405e-98af-c30502e52b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.566058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a33f9-bfd4-405e-98af-c30502e52b2f None admin] PATH_INFO: `/v3/users/aa2794a5a2cb463787b9e7bc82103b03` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.567632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a33f9-bfd4-405e-98af-c30502e52b2f None admin] RBAC: Authorizing `identity:get_user(user_id=aa2794a5a2cb463787b9e7bc82103b03)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:30.569131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a33f9-bfd4-405e-98af-c30502e52b2f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:30.570753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 26/51] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:30 2022] GET /identity/v3/users/aa2794a5a2cb463787b9e7bc82103b03 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:30.573852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a24d0-e95c-4d04-8e8e-36929e744a23 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.574208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a24d0-e95c-4d04-8e8e-36929e744a23 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.574492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a24d0-e95c-4d04-8e8e-36929e744a23 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.575896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 26/52] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:30.576124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a33f9-bfd4-405e-98af-c30502e52b2f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:30.580858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7949e0-31e5-4152-a14e-b61abba71e4d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.581141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7949e0-31e5-4152-a14e-b61abba71e4d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.581412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7949e0-31e5-4152-a14e-b61abba71e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.599206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9a7949e0-31e5-4152-a14e-b61abba71e4d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:30.600431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9a7949e0-31e5-4152-a14e-b61abba71e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:30.680243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 27/53] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:30.703540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7949e0-31e5-4152-a14e-b61abba71e4d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:30.727094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:30.753582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:30.799425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a33f9-bfd4-405e-98af-c30502e52b2f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:30.809569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7949e0-31e5-4152-a14e-b61abba71e4d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:30.834068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332326-4431-47cd-a495-f5aea7b277eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:30.835159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332326-4431-47cd-a495-f5aea7b277eb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.835650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332326-4431-47cd-a495-f5aea7b277eb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.835940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97332326-4431-47cd-a495-f5aea7b277eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.837122 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97332326-4431-47cd-a495-f5aea7b277eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:30.838602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97332326-4431-47cd-a495-f5aea7b277eb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:30.840279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 27/54] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:30.843431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4faa02-56ac-4b9b-8904-46794dae1469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:30.844312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4faa02-56ac-4b9b-8904-46794dae1469 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.844596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4faa02-56ac-4b9b-8904-46794dae1469 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.844891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4faa02-56ac-4b9b-8904-46794dae1469 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.846074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4faa02-56ac-4b9b-8904-46794dae1469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:30.846173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332326-4431-47cd-a495-f5aea7b277eb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:30.847584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4faa02-56ac-4b9b-8904-46794dae1469 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:30.849210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 28/55] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:30.854758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4faa02-56ac-4b9b-8904-46794dae1469 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:30.940229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:30.953205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97332326-4431-47cd-a495-f5aea7b277eb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:30.960283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4faa02-56ac-4b9b-8904-46794dae1469 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:30.975922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:30.986862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145bbf3-1c98-4ac4-ba3d-76a9723edd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:30.987745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145bbf3-1c98-4ac4-ba3d-76a9723edd3d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.988032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145bbf3-1c98-4ac4-ba3d-76a9723edd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.988313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145bbf3-1c98-4ac4-ba3d-76a9723edd3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.989162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145bbf3-1c98-4ac4-ba3d-76a9723edd3d None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.domain.id=default, user.id=aa2794a5a2cb463787b9e7bc82103b03) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:30.989477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145bbf3-1c98-4ac4-ba3d-76a9723edd3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:30.990943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145bbf3-1c98-4ac4-ba3d-76a9723edd3d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:30.994272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08620e54-4698-4a24-a167-79835f1e230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:30.994941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620e54-4698-4a24-a167-79835f1e230d None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:30.995676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620e54-4698-4a24-a167-79835f1e230d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:30.995956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620e54-4698-4a24-a167-79835f1e230d None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:30.996705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08620e54-4698-4a24-a167-79835f1e230d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:30.998168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08620e54-4698-4a24-a167-79835f1e230d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:31.000376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 28/56] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Jul 20 15:14:30 2022] GET /identity/v3/role_assignments?user.id=aa2794a5a2cb463787b9e7bc82103b03&scope.domain.id=default&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:31.026714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 29/57] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Jul 20 15:14:30 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:33.100752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f95a-0906-479c-89f8-3999a2dd7e76 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:33.101330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f95a-0906-479c-89f8-3999a2dd7e76 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:33.101330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f95a-0906-479c-89f8-3999a2dd7e76 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:33.102776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 29/58] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:33.109165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950437-bae5-40d6-8f87-c243defc72d9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:33.109740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950437-bae5-40d6-8f87-c243defc72d9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:33.109945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950437-bae5-40d6-8f87-c243defc72d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:33.137210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-da950437-bae5-40d6-8f87-c243defc72d9 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:33.138411 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-da950437-bae5-40d6-8f87-c243defc72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:33.218401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 30/59] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:33.243073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177f95a-0906-479c-89f8-3999a2dd7e76 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:33.350086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177f95a-0906-479c-89f8-3999a2dd7e76 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:33.386113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb784cb6-fb07-473c-bf06-a567167e32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:33.386906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784cb6-fb07-473c-bf06-a567167e32f5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:33.387213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784cb6-fb07-473c-bf06-a567167e32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:33.387488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784cb6-fb07-473c-bf06-a567167e32f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:33.388860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb784cb6-fb07-473c-bf06-a567167e32f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:33.390431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb784cb6-fb07-473c-bf06-a567167e32f5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:33.392146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 30/60] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:33.400075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950437-bae5-40d6-8f87-c243defc72d9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:33.474091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:33.513458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950437-bae5-40d6-8f87-c243defc72d9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:33.553371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdf87e-9d0a-4492-a7fb-f3c1c00498a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:33.554041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf87e-9d0a-4492-a7fb-f3c1c00498a6 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:33.554360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf87e-9d0a-4492-a7fb-f3c1c00498a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:33.554633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdf87e-9d0a-4492-a7fb-f3c1c00498a6 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:33.555382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdf87e-9d0a-4492-a7fb-f3c1c00498a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:33.556842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdf87e-9d0a-4492-a7fb-f3c1c00498a6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:33.583457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 31/61] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:14:33 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:14:36.784791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395519f9-8bc2-4f7a-8084-243709525bf7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:36.785696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395519f9-8bc2-4f7a-8084-243709525bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:36.786114 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395519f9-8bc2-4f7a-8084-243709525bf7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:36.787673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 31/62] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:36.793261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6715-1885-4d44-b521-48d4390df3e3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:36.794008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6715-1885-4d44-b521-48d4390df3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:36.794440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6715-1885-4d44-b521-48d4390df3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:36.820122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-055e6715-1885-4d44-b521-48d4390df3e3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:36.821571 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-055e6715-1885-4d44-b521-48d4390df3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:36.917353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414724-9487-44c9-87cd-e8ae2ad6e230 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:36.917861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414724-9487-44c9-87cd-e8ae2ad6e230 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:36.918298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414724-9487-44c9-87cd-e8ae2ad6e230 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:36.919832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 32/63] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:14:36.922504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 32/64] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:36.928317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfe2ae-3896-4329-9c2e-a6e274973bec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:36.928771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfe2ae-3896-4329-9c2e-a6e274973bec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:36.929226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfe2ae-3896-4329-9c2e-a6e274973bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:36.946279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6715-1885-4d44-b521-48d4390df3e3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:36.950633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-adcfe2ae-3896-4329-9c2e-a6e274973bec None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:36.951150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-adcfe2ae-3896-4329-9c2e-a6e274973bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:37.002191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.008372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.032303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 33/65] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:37.034095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a377d-237d-4228-8adc-5bf72180705b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.035047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a377d-237d-4228-8adc-5bf72180705b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.035467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a377d-237d-4228-8adc-5bf72180705b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.037175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 34/66] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:37.042736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493a72d-ac99-48ca-803f-905508de266d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.043274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493a72d-ac99-48ca-803f-905508de266d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.043744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493a72d-ac99-48ca-803f-905508de266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.054718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6715-1885-4d44-b521-48d4390df3e3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.063145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4493a72d-ac99-48ca-803f-905508de266d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:37.065059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4493a72d-ac99-48ca-803f-905508de266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:37.092555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac6ba-a800-4526-a945-306d063d8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.093851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac6ba-a800-4526-a945-306d063d8d45 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.094321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac6ba-a800-4526-a945-306d063d8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.094779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac6ba-a800-4526-a945-306d063d8d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.108195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfac6ba-a800-4526-a945-306d063d8d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9bfac6ba-a800-4526-a945-306d063d8d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:37.117927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:37.119014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:37.120372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:37.122986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 33/67] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:14:37.124005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac6ba-a800-4526-a945-306d063d8d45 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.151020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 35/68] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:37.152012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493a72d-ac99-48ca-803f-905508de266d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.250613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac6ba-a800-4526-a945-306d063d8d45 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.268412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.282734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493a72d-ac99-48ca-803f-905508de266d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.291376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37b72e-da5f-4a9b-89b0-0f3d9c0e235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.292154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37b72e-da5f-4a9b-89b0-0f3d9c0e235d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.292444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37b72e-da5f-4a9b-89b0-0f3d9c0e235d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.292723 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37b72e-da5f-4a9b-89b0-0f3d9c0e235d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.300027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.305905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37b72e-da5f-4a9b-89b0-0f3d9c0e235d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8b37b72e-da5f-4a9b-89b0-0f3d9c0e235d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:37.314104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:37.314955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:37.315766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:37.316381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37b72e-da5f-4a9b-89b0-0f3d9c0e235d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.324176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ad1db-d7f6-41e1-bd2e-c1d4b8eb3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.324866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ad1db-d7f6-41e1-bd2e-c1d4b8eb3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.325151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ad1db-d7f6-41e1-bd2e-c1d4b8eb3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.325421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ad1db-d7f6-41e1-bd2e-c1d4b8eb3ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.326724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ad1db-d7f6-41e1-bd2e-c1d4b8eb3ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:37.327069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ad1db-d7f6-41e1-bd2e-c1d4b8eb3ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:37.328959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ad1db-d7f6-41e1-bd2e-c1d4b8eb3ff7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:37.342664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 36/70] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:37.342664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017021-0163-4965-931c-df2b26d8a56d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.342664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017021-0163-4965-931c-df2b26d8a56d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.342664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d017021-0163-4965-931c-df2b26d8a56d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.342664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 37/71] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:37.347130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d017021-0163-4965-931c-df2b26d8a56d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.420561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37b72e-da5f-4a9b-89b0-0f3d9c0e235d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.449437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d017021-0163-4965-931c-df2b26d8a56d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.457229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c5f0b-6319-4ec0-8dbf-04a025308f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.458046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c5f0b-6319-4ec0-8dbf-04a025308f33 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.458332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c5f0b-6319-4ec0-8dbf-04a025308f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.458611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c5f0b-6319-4ec0-8dbf-04a025308f33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.470063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c5f0b-6319-4ec0-8dbf-04a025308f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ec7c5f0b-6319-4ec0-8dbf-04a025308f33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:37.477903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:37.478908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:37.479689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 35/72] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:37.480307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c5f0b-6319-4ec0-8dbf-04a025308f33 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.488979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7d51c-a93d-42ad-820d-ac62958b5bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.489657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d51c-a93d-42ad-820d-ac62958b5bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.489939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d51c-a93d-42ad-820d-ac62958b5bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.490213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d51c-a93d-42ad-820d-ac62958b5bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.490987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7d51c-a93d-42ad-820d-ac62958b5bc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:37.491305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7d51c-a93d-42ad-820d-ac62958b5bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:37.492772 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7d51c-a93d-42ad-820d-ac62958b5bc3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:37.501790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 38/73] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:37.502987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50547b08-50d1-4c84-9a63-ee6ae9a159d6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.503288 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50547b08-50d1-4c84-9a63-ee6ae9a159d6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.503565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50547b08-50d1-4c84-9a63-ee6ae9a159d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.514945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.520762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-50547b08-50d1-4c84-9a63-ee6ae9a159d6 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:37.521998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-50547b08-50d1-4c84-9a63-ee6ae9a159d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:37.557820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.586635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c5f0b-6319-4ec0-8dbf-04a025308f33 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.591835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 39/74] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:37.593543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647651a-b868-4576-a722-4dc69f029370 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.594018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647651a-b868-4576-a722-4dc69f029370 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.594477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647651a-b868-4576-a722-4dc69f029370 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.596556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 40/75] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:37.597977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647651a-b868-4576-a722-4dc69f029370 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.624614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a921-663f-4a6e-96fd-3df9ca391b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.625506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a921-663f-4a6e-96fd-3df9ca391b21 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.625784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a921-663f-4a6e-96fd-3df9ca391b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.626058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a921-663f-4a6e-96fd-3df9ca391b21 None admin] PATH_INFO: `/v3/users/aa2794a5a2cb463787b9e7bc82103b03` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.627305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84a921-663f-4a6e-96fd-3df9ca391b21 None admin] RBAC: Authorizing `identity:get_user(user_id=aa2794a5a2cb463787b9e7bc82103b03)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:37.628803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84a921-663f-4a6e-96fd-3df9ca391b21 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:37.634900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 36/76] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/users/aa2794a5a2cb463787b9e7bc82103b03 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:37.634900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a921-663f-4a6e-96fd-3df9ca391b21 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.704800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647651a-b868-4576-a722-4dc69f029370 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.730913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.733866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a921-663f-4a6e-96fd-3df9ca391b21 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.738401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdecb3-f8c8-4023-b111-8d10a1d7ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.739118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdecb3-f8c8-4023-b111-8d10a1d7ca42 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.739408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdecb3-f8c8-4023-b111-8d10a1d7ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.739684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdecb3-f8c8-4023-b111-8d10a1d7ca42 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.740437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdecb3-f8c8-4023-b111-8d10a1d7ca42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:37.740749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdecb3-f8c8-4023-b111-8d10a1d7ca42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:37.742186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdecb3-f8c8-4023-b111-8d10a1d7ca42 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:37.750888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 41/77] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:37.756891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab1f6-13fd-468d-a21b-a1c6dafc85c4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.757219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab1f6-13fd-468d-a21b-a1c6dafc85c4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.757563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab1f6-13fd-468d-a21b-a1c6dafc85c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.768126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaef9f1-cab1-4f56-9156-4a22e9acb8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.769014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaef9f1-cab1-4f56-9156-4a22e9acb8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.769294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaef9f1-cab1-4f56-9156-4a22e9acb8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.769573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaef9f1-cab1-4f56-9156-4a22e9acb8e2 None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.773618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-004ab1f6-13fd-468d-a21b-a1c6dafc85c4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:37.774874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-004ab1f6-13fd-468d-a21b-a1c6dafc85c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:37.783266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaef9f1-cab1-4f56-9156-4a22e9acb8e2 None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:37.784751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaef9f1-cab1-4f56-9156-4a22e9acb8e2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:37.786451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 37/78] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:37.787256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaef9f1-cab1-4f56-9156-4a22e9acb8e2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.805549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.849676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 42/79] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:37.851858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab1f6-13fd-468d-a21b-a1c6dafc85c4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.891695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaef9f1-cab1-4f56-9156-4a22e9acb8e2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.924750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765075ac-0664-4c95-8236-a0ea90b2d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.925558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765075ac-0664-4c95-8236-a0ea90b2d7ff None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.925845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765075ac-0664-4c95-8236-a0ea90b2d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.926126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765075ac-0664-4c95-8236-a0ea90b2d7ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:37.936163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765075ac-0664-4c95-8236-a0ea90b2d7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-765075ac-0664-4c95-8236-a0ea90b2d7ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:37.943996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:37.944897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:37.945680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 38/80] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:37.946415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765075ac-0664-4c95-8236-a0ea90b2d7ff None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:37.960029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab1f6-13fd-468d-a21b-a1c6dafc85c4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:37.965848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:37.996435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394ecf1-82ff-4991-8ec2-41d4f096093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:37.997094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394ecf1-82ff-4991-8ec2-41d4f096093d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:37.997376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394ecf1-82ff-4991-8ec2-41d4f096093d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:37.997626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394ecf1-82ff-4991-8ec2-41d4f096093d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.027255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.046504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765075ac-0664-4c95-8236-a0ea90b2d7ff None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.064851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394ecf1-82ff-4991-8ec2-41d4f096093d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.066359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394ecf1-82ff-4991-8ec2-41d4f096093d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.078682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082ceb4-102d-49ef-89c3-4e61495c5ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.079601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ceb4-102d-49ef-89c3-4e61495c5ffe None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.079877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ceb4-102d-49ef-89c3-4e61495c5ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.080155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ceb4-102d-49ef-89c3-4e61495c5ffe None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.081359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082ceb4-102d-49ef-89c3-4e61495c5ffe None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.082829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082ceb4-102d-49ef-89c3-4e61495c5ffe None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.084504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 39/81] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:38.085266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082ceb4-102d-49ef-89c3-4e61495c5ffe None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.164977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 43/82] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:38.165735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394ecf1-82ff-4991-8ec2-41d4f096093d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.173754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.189200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082ceb4-102d-49ef-89c3-4e61495c5ffe None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.222323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67efea-89b3-4a8c-af65-d8aeed972316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.223005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67efea-89b3-4a8c-af65-d8aeed972316 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.223286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67efea-89b3-4a8c-af65-d8aeed972316 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.223561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67efea-89b3-4a8c-af65-d8aeed972316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.224167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.261287 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394ecf1-82ff-4991-8ec2-41d4f096093d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.294490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67efea-89b3-4a8c-af65-d8aeed972316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.296023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67efea-89b3-4a8c-af65-d8aeed972316 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.296204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf617c-5ee3-4b3d-83aa-40e1241f2cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.297016 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf617c-5ee3-4b3d-83aa-40e1241f2cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.297313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf617c-5ee3-4b3d-83aa-40e1241f2cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.297570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf617c-5ee3-4b3d-83aa-40e1241f2cb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.298757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf617c-5ee3-4b3d-83aa-40e1241f2cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.300252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf617c-5ee3-4b3d-83aa-40e1241f2cb0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.301913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 44/83] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:38.302682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf617c-5ee3-4b3d-83aa-40e1241f2cb0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.380172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.396449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 40/84] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:38.397402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67efea-89b3-4a8c-af65-d8aeed972316 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.405518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf617c-5ee3-4b3d-83aa-40e1241f2cb0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.434516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.441322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.441993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.442296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.442574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.443363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:38.443670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.445122 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.453248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 45/85] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:38.454155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.501891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67efea-89b3-4a8c-af65-d8aeed972316 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.535559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b98f0-4b6f-459b-8c2f-6989b8872360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.536215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b98f0-4b6f-459b-8c2f-6989b8872360 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.536498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b98f0-4b6f-459b-8c2f-6989b8872360 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.536775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b98f0-4b6f-459b-8c2f-6989b8872360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.552281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4d3f6-7a80-420c-b48c-e94897093c9e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.585125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f006cc-67da-4ed8-bb6f-61805d42205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.586059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f006cc-67da-4ed8-bb6f-61805d42205e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.586344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f006cc-67da-4ed8-bb6f-61805d42205e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.586621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f006cc-67da-4ed8-bb6f-61805d42205e None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.587873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f006cc-67da-4ed8-bb6f-61805d42205e None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.589365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f006cc-67da-4ed8-bb6f-61805d42205e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.590934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.591108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 46/86] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:38.591855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f006cc-67da-4ed8-bb6f-61805d42205e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.609682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b98f0-4b6f-459b-8c2f-6989b8872360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.611213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b98f0-4b6f-459b-8c2f-6989b8872360 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.651286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.692431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f006cc-67da-4ed8-bb6f-61805d42205e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.710322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 41/87] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:38.711210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b98f0-4b6f-459b-8c2f-6989b8872360 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.730942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd583-c30a-45a7-895d-587b4ea354e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.731664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd583-c30a-45a7-895d-587b4ea354e2 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.731942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd583-c30a-45a7-895d-587b4ea354e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.732223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd583-c30a-45a7-895d-587b4ea354e2 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.732950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcd583-c30a-45a7-895d-587b4ea354e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.734439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcd583-c30a-45a7-895d-587b4ea354e2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.763365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 47/88] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:14:38 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:38.764186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd583-c30a-45a7-895d-587b4ea354e2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.800510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.817716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b98f0-4b6f-459b-8c2f-6989b8872360 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.855945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89260c-2ef6-475c-aff9-5995dae51ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.856841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89260c-2ef6-475c-aff9-5995dae51ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.857138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89260c-2ef6-475c-aff9-5995dae51ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.857397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89260c-2ef6-475c-aff9-5995dae51ac1 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.858634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89260c-2ef6-475c-aff9-5995dae51ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.860195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89260c-2ef6-475c-aff9-5995dae51ac1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.861991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 42/89] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:38.862811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89260c-2ef6-475c-aff9-5995dae51ac1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.888435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd583-c30a-45a7-895d-587b4ea354e2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:38.908831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:38.942649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230474e-a47f-4844-bb0e-1121cce1b390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:38.942649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230474e-a47f-4844-bb0e-1121cce1b390 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:38.942649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230474e-a47f-4844-bb0e-1121cce1b390 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:38.942649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230474e-a47f-4844-bb0e-1121cce1b390 None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:38.943065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230474e-a47f-4844-bb0e-1121cce1b390 None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:38.945517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230474e-a47f-4844-bb0e-1121cce1b390 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:38.948146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 48/90] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:38.949007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230474e-a47f-4844-bb0e-1121cce1b390 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:38.987914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89260c-2ef6-475c-aff9-5995dae51ac1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:39.031454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:39.032389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:39.032570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:39.034352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:39.034352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=d841afc24eab4adcbe2c3086e54770c3, user.id=aa2794a5a2cb463787b9e7bc82103b03) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:39.034352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:39.035491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:39.044316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 43/91] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/role_assignments?user.id=aa2794a5a2cb463787b9e7bc82103b03&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:39.044998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:39.073173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230474e-a47f-4844-bb0e-1121cce1b390 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:39.073718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:39.117671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67a0e-22f1-46d4-a5b1-b660804300ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:39.118901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67a0e-22f1-46d4-a5b1-b660804300ad None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:39.119218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67a0e-22f1-46d4-a5b1-b660804300ad None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:39.119512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67a0e-22f1-46d4-a5b1-b660804300ad None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:39.121555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa67a0e-22f1-46d4-a5b1-b660804300ad None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:39.123763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa67a0e-22f1-46d4-a5b1-b660804300ad None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:39.125028 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 49/92] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:38 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:39.125770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67a0e-22f1-46d4-a5b1-b660804300ad None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:39.182517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c957b47-c8c3-4c8e-bdaf-665202191563 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:39.221078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:39.242645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:39.243644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:39.244106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:39.244633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:39.246065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] RBAC: Adding query filter params (role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=d841afc24eab4adcbe2c3086e54770c3, user.id=2628faec3f214ca38f3d8be5f4a57eb1) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:39.246628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:39.249241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:39.255719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 44/93] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:39 2022] GET /identity/v3/role_assignments?user.id=2628faec3f214ca38f3d8be5f4a57eb1&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=ad532b5de50547a7a0f952954be2d53e => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:39.257356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:39.290919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67a0e-22f1-46d4-a5b1-b660804300ad None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:39.382066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90924ad9-4e0a-40d4-a51d-a84c319b05b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:39.382792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90924ad9-4e0a-40d4-a51d-a84c319b05b1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:39.383102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90924ad9-4e0a-40d4-a51d-a84c319b05b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:39.383377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90924ad9-4e0a-40d4-a51d-a84c319b05b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:39.419730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:39.444270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ec2bb-2e1d-424e-b7f0-312821f6565a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:39.483888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:39.484847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:39.485313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:39.485782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:39.486803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] RBAC: Adding query filter params (role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=d841afc24eab4adcbe2c3086e54770c3, user.id=2628faec3f214ca38f3d8be5f4a57eb1) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:39.487311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:39.488988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:39.496135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 45/94] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:39 2022] GET /identity/v3/role_assignments?user.id=2628faec3f214ca38f3d8be5f4a57eb1&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:39.524468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90924ad9-4e0a-40d4-a51d-a84c319b05b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:39.526435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90924ad9-4e0a-40d4-a51d-a84c319b05b1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:39.598277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:39.684585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 50/95] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:39.691917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:39.812168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac6c9-7c8b-484a-a8b6-4675b9e5bdce None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:39.859717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4b79a-48dc-4e82-9cae-9cc040212da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:39.860912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b79a-48dc-4e82-9cae-9cc040212da2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:39.861365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b79a-48dc-4e82-9cae-9cc040212da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:39.861827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4b79a-48dc-4e82-9cae-9cc040212da2 None admin] PATH_INFO: `/v3/projects/7a41f5686b56474488163f77817217d8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:39.863251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4b79a-48dc-4e82-9cae-9cc040212da2 None admin] RBAC: Authorizing `identity:get_project(project_id=7a41f5686b56474488163f77817217d8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:39.864948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4b79a-48dc-4e82-9cae-9cc040212da2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:39.866879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 46/96] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:39 2022] GET /identity/v3/projects/7a41f5686b56474488163f77817217d8 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:39.873475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90924ad9-4e0a-40d4-a51d-a84c319b05b1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:39.989712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90924ad9-4e0a-40d4-a51d-a84c319b05b1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:40.045376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab583cc-f0b5-4829-b533-58216e85b315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:40.046059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab583cc-f0b5-4829-b533-58216e85b315 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:40.046341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab583cc-f0b5-4829-b533-58216e85b315 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:40.046613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab583cc-f0b5-4829-b533-58216e85b315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:40.047494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab583cc-f0b5-4829-b533-58216e85b315 None admin] RBAC: Adding query filter params (role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=7a41f5686b56474488163f77817217d8, user.id=2628faec3f214ca38f3d8be5f4a57eb1) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:40.047801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab583cc-f0b5-4829-b533-58216e85b315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:40.049274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab583cc-f0b5-4829-b533-58216e85b315 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:40.059617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 51/97] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:39 2022] GET /identity/v3/role_assignments?user.id=2628faec3f214ca38f3d8be5f4a57eb1&scope.project.id=7a41f5686b56474488163f77817217d8&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:41.481214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633e88-9f1b-4832-8c6b-9e668b11a5f3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:41.481911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633e88-9f1b-4832-8c6b-9e668b11a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:41.481911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633e88-9f1b-4832-8c6b-9e668b11a5f3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:41.484402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 47/98] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:41.492874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796af671-5bd5-4558-9ed6-05bfbb71b826 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:41.493390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796af671-5bd5-4558-9ed6-05bfbb71b826 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:41.493492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796af671-5bd5-4558-9ed6-05bfbb71b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:41.516030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-796af671-5bd5-4558-9ed6-05bfbb71b826 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:41.517248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-796af671-5bd5-4558-9ed6-05bfbb71b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:41.528763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:41.602261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 52/99] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:41.637936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f633e88-9f1b-4832-8c6b-9e668b11a5f3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:41.656196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:41.759595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f633e88-9f1b-4832-8c6b-9e668b11a5f3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:41.800438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2162b7e-1a4d-4e02-93ab-c55763265575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:41.801344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162b7e-1a4d-4e02-93ab-c55763265575 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:41.801626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162b7e-1a4d-4e02-93ab-c55763265575 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:41.801901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2162b7e-1a4d-4e02-93ab-c55763265575 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:41.816686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2162b7e-1a4d-4e02-93ab-c55763265575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f2162b7e-1a4d-4e02-93ab-c55763265575 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:41.824548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:41.825408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:41.826170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 48/100] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:41.833133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796af671-5bd5-4558-9ed6-05bfbb71b826 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:41.906482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de081189-87c6-48bd-9698-13591cfe2847 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:41.906805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de081189-87c6-48bd-9698-13591cfe2847 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:41.907063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de081189-87c6-48bd-9698-13591cfe2847 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:41.908450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 49/101] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:14:41.913553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48781-f48b-48d0-ac03-febcd60d826a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:41.913836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48781-f48b-48d0-ac03-febcd60d826a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:41.914111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48781-f48b-48d0-ac03-febcd60d826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:41.940475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1ea48781-f48b-48d0-ac03-febcd60d826a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:41.941694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ea48781-f48b-48d0-ac03-febcd60d826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:41.973243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796af671-5bd5-4558-9ed6-05bfbb71b826 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:42.040709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:42.041314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.041592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.041860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.042617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:42.042919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:42.047741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:42.051282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 50/102] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:42.052706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f39622-954a-4992-97d7-2e28d7e7721b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.052993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f39622-954a-4992-97d7-2e28d7e7721b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.053268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f39622-954a-4992-97d7-2e28d7e7721b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.054574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 51/103] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:42.060024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8a21-e1c2-435a-a9bf-87e6ac65f694 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.060307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8a21-e1c2-435a-a9bf-87e6ac65f694 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.060688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8a21-e1c2-435a-a9bf-87e6ac65f694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.066404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 53/104] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:42.078175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:42.081994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bcaa8a21-e1c2-435a-a9bf-87e6ac65f694 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:42.083581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bcaa8a21-e1c2-435a-a9bf-87e6ac65f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:42.091016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:42.091587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:42.223817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 52/105] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:42.224680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8a21-e1c2-435a-a9bf-87e6ac65f694 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:42.242121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859f4ae-7760-4277-97b8-e3f47c1cf2bf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:42.312281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a87f-bd75-4991-89da-0598412f3679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:42.313202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a87f-bd75-4991-89da-0598412f3679 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.313486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a87f-bd75-4991-89da-0598412f3679 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.313761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a87f-bd75-4991-89da-0598412f3679 None admin] PATH_INFO: `/v3/users/b78fa3f57f2d437a9eb5fdf942c14586` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.341813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905a87f-bd75-4991-89da-0598412f3679 None admin] RBAC: Authorizing `identity:get_user(user_id=b78fa3f57f2d437a9eb5fdf942c14586)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:42.343362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905a87f-bd75-4991-89da-0598412f3679 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:42.345287 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 54/106] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:42 2022] GET /identity/v3/users/b78fa3f57f2d437a9eb5fdf942c14586 => generated 289 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:42.346060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a87f-bd75-4991-89da-0598412f3679 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:42.421079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:42.453508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a87f-bd75-4991-89da-0598412f3679 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:42.473165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8a21-e1c2-435a-a9bf-87e6ac65f694 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:42.487831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f71d-0ed5-4a86-a8d2-720e8188b69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:42.488652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f71d-0ed5-4a86-a8d2-720e8188b69d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.488932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f71d-0ed5-4a86-a8d2-720e8188b69d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.489203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f71d-0ed5-4a86-a8d2-720e8188b69d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.500797 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f71d-0ed5-4a86-a8d2-720e8188b69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5117f71d-0ed5-4a86-a8d2-720e8188b69d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:42.508756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:42.509836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:42.510770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:42.512875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 55/107] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:42.513918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f71d-0ed5-4a86-a8d2-720e8188b69d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:42.566414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72925a85-24bb-4012-a83f-0c853afa1eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:42.567256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925a85-24bb-4012-a83f-0c853afa1eae None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.567560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925a85-24bb-4012-a83f-0c853afa1eae None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.568015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925a85-24bb-4012-a83f-0c853afa1eae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.569387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72925a85-24bb-4012-a83f-0c853afa1eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:42.571244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72925a85-24bb-4012-a83f-0c853afa1eae None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:42.573357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 53/108] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:42.574346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72925a85-24bb-4012-a83f-0c853afa1eae None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:42.577552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:42.626321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f71d-0ed5-4a86-a8d2-720e8188b69d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:42.656883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:42.666933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0180-17b3-4910-a1b0-1c7d4fbd1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:42.667664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0180-17b3-4910-a1b0-1c7d4fbd1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.667956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0180-17b3-4910-a1b0-1c7d4fbd1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.668239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0180-17b3-4910-a1b0-1c7d4fbd1fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.685369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72925a85-24bb-4012-a83f-0c853afa1eae None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:42.722946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d5b83-fab3-4a62-afb3-371bf4aff27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:42.724072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5b83-fab3-4a62-afb3-371bf4aff27e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.724361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5b83-fab3-4a62-afb3-371bf4aff27e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.724792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5b83-fab3-4a62-afb3-371bf4aff27e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.725563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d5b83-fab3-4a62-afb3-371bf4aff27e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:42.725941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d5b83-fab3-4a62-afb3-371bf4aff27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:42.727390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d5b83-fab3-4a62-afb3-371bf4aff27e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:42.735712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 54/109] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:42.736970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692f0f-7b44-4396-9cc7-97b501accf56 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.737259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692f0f-7b44-4396-9cc7-97b501accf56 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.737543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692f0f-7b44-4396-9cc7-97b501accf56 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.742769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 55/110] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:42.742769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71692f0f-7b44-4396-9cc7-97b501accf56 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:42.747215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec0180-17b3-4910-a1b0-1c7d4fbd1fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:42.748409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec0180-17b3-4910-a1b0-1c7d4fbd1fa4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:42.811949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:42.861336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71692f0f-7b44-4396-9cc7-97b501accf56 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:42.861497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 56/111] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:42.862876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906aab-33b6-49f7-b1dd-8216a0f7b7f6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.867657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906aab-33b6-49f7-b1dd-8216a0f7b7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.867657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7906aab-33b6-49f7-b1dd-8216a0f7b7f6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.867657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 57/112] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:42.867657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7906aab-33b6-49f7-b1dd-8216a0f7b7f6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:42.896660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53df38-4125-467f-9ccf-d55fbf5f81f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:42.897332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53df38-4125-467f-9ccf-d55fbf5f81f3 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.897612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53df38-4125-467f-9ccf-d55fbf5f81f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.897913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53df38-4125-467f-9ccf-d55fbf5f81f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.898632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53df38-4125-467f-9ccf-d55fbf5f81f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:42.900128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53df38-4125-467f-9ccf-d55fbf5f81f3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:42.901013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:42.934028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 56/113] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:14:42 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:42.935796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac4bb-4be9-40a8-afd6-ab61891a62cb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:42.936555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac4bb-4be9-40a8-afd6-ab61891a62cb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:42.936833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac4bb-4be9-40a8-afd6-ab61891a62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:42.959350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-56eac4bb-4be9-40a8-afd6-ab61891a62cb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:42.960642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-56eac4bb-4be9-40a8-afd6-ab61891a62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:43.037539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7906aab-33b6-49f7-b1dd-8216a0f7b7f6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.061645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 57/114] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:43.074905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac4bb-4be9-40a8-afd6-ab61891a62cb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:43.077326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d95af-7fee-4dcb-af75-b5560e4cf5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:43.078248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d95af-7fee-4dcb-af75-b5560e4cf5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.078519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d95af-7fee-4dcb-af75-b5560e4cf5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.078794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d95af-7fee-4dcb-af75-b5560e4cf5e6 None admin] PATH_INFO: `/v3/users/aa2794a5a2cb463787b9e7bc82103b03` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.080063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d95af-7fee-4dcb-af75-b5560e4cf5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=aa2794a5a2cb463787b9e7bc82103b03)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:43.081552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d95af-7fee-4dcb-af75-b5560e4cf5e6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:43.083300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 58/115] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:42 2022] GET /identity/v3/users/aa2794a5a2cb463787b9e7bc82103b03 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:43.084529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cecb4-cfd3-472c-a621-55c9a48da2bc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.084808 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cecb4-cfd3-472c-a621-55c9a48da2bc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.085076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cecb4-cfd3-472c-a621-55c9a48da2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.130200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c53cecb4-cfd3-472c-a621-55c9a48da2bc None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:43.131525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c53cecb4-cfd3-472c-a621-55c9a48da2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:43.173698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:43.235015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 59/116] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:43.235015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cecb4-cfd3-472c-a621-55c9a48da2bc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:43.260278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:43.266794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac4bb-4be9-40a8-afd6-ab61891a62cb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.317936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b050b78-9e5a-49d6-9f33-cd1178400c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:43.318815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050b78-9e5a-49d6-9f33-cd1178400c96 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.319119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050b78-9e5a-49d6-9f33-cd1178400c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.319396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b050b78-9e5a-49d6-9f33-cd1178400c96 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.320607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b050b78-9e5a-49d6-9f33-cd1178400c96 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:43.322093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b050b78-9e5a-49d6-9f33-cd1178400c96 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:43.323833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 58/117] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:43 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:43.329403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b050b78-9e5a-49d6-9f33-cd1178400c96 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:43.346527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cecb4-cfd3-472c-a621-55c9a48da2bc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.381869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2064081-29e5-41d9-926c-602fd61ea36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:43.382713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064081-29e5-41d9-926c-602fd61ea36a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.383020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064081-29e5-41d9-926c-602fd61ea36a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.383300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064081-29e5-41d9-926c-602fd61ea36a None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.384518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064081-29e5-41d9-926c-602fd61ea36a None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:43.385996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064081-29e5-41d9-926c-602fd61ea36a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:43.388108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 60/118] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:43 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:43.389175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf5d4-11ca-4d92-a8cf-c2c53b5d497e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.389463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf5d4-11ca-4d92-a8cf-c2c53b5d497e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.389738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf5d4-11ca-4d92-a8cf-c2c53b5d497e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.395302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 61/119] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:43.395302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaf5d4-11ca-4d92-a8cf-c2c53b5d497e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:43.437185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b050b78-9e5a-49d6-9f33-cd1178400c96 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.453924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:43.481347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1ae30-3362-4156-9457-45f414cbcf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:43.482175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1ae30-3362-4156-9457-45f414cbcf5a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.482460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1ae30-3362-4156-9457-45f414cbcf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.482733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1ae30-3362-4156-9457-45f414cbcf5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.494336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:43.495671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1ae30-3362-4156-9457-45f414cbcf5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-19a1ae30-3362-4156-9457-45f414cbcf5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:43.506251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:43.507390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:43.508144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 59/120] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:14:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:43.509418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1ae30-3362-4156-9457-45f414cbcf5a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:43.509803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaf5d4-11ca-4d92-a8cf-c2c53b5d497e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.553581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fa969-e21c-4a43-804b-937a292f81bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:43.554730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fa969-e21c-4a43-804b-937a292f81bb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.555294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fa969-e21c-4a43-804b-937a292f81bb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.555581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fa969-e21c-4a43-804b-937a292f81bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.572176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fa969-e21c-4a43-804b-937a292f81bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-401fa969-e21c-4a43-804b-937a292f81bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:43.579907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:43.580817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:43.581599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 62/121] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:43.582589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fa969-e21c-4a43-804b-937a292f81bb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:43.622621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1ae30-3362-4156-9457-45f414cbcf5a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.658904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13490a-6134-40d1-a6ee-374ea3b58b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:43.659531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13490a-6134-40d1-a6ee-374ea3b58b66 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.659819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13490a-6134-40d1-a6ee-374ea3b58b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.660094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13490a-6134-40d1-a6ee-374ea3b58b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.660971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13490a-6134-40d1-a6ee-374ea3b58b66 None admin] RBAC: Adding query filter params (role.id=9fb0a387eaf44abaa59f4cf3a9596f8c, scope.project.id=d841afc24eab4adcbe2c3086e54770c3, user.id=b78fa3f57f2d437a9eb5fdf942c14586) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:43.661286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13490a-6134-40d1-a6ee-374ea3b58b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:43.662817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13490a-6134-40d1-a6ee-374ea3b58b66 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:43.675455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 60/122] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:43 2022] GET /identity/v3/role_assignments?user.id=b78fa3f57f2d437a9eb5fdf942c14586&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=9fb0a387eaf44abaa59f4cf3a9596f8c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:43.675455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4425c-2b8d-4799-98e1-84d79e0c58ec None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.675455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4425c-2b8d-4799-98e1-84d79e0c58ec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.675455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4425c-2b8d-4799-98e1-84d79e0c58ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.689290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c7c4425c-2b8d-4799-98e1-84d79e0c58ec None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:43.690688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c7c4425c-2b8d-4799-98e1-84d79e0c58ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:43.700900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fa969-e21c-4a43-804b-937a292f81bb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.727177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:43.759947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eff8f-478f-4169-92e3-cead21facb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:43.762030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eff8f-478f-4169-92e3-cead21facb54 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.762817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eff8f-478f-4169-92e3-cead21facb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.763297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eff8f-478f-4169-92e3-cead21facb54 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3/users/aa2794a5a2cb463787b9e7bc82103b03/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.766800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eff8f-478f-4169-92e3-cead21facb54 None admin] RBAC: Authorizing `identity:create_grant(project_id=d841afc24eab4adcbe2c3086e54770c3, user_id=aa2794a5a2cb463787b9e7bc82103b03, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:43.769498 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eff8f-478f-4169-92e3-cead21facb54 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:43.778112 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 61/123] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:43.780402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4425c-2b8d-4799-98e1-84d79e0c58ec None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:43.798036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 63/124] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:14:43 2022] PUT /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3/users/aa2794a5a2cb463787b9e7bc82103b03/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:14:43.799278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eff8f-478f-4169-92e3-cead21facb54 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:43.823785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:43.914548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4425c-2b8d-4799-98e1-84d79e0c58ec None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.931739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eff8f-478f-4169-92e3-cead21facb54 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:43.986282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:43.988241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:43.988532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:43.990160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:43.990984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:43.992192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:43.993669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:44.002943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:44.003670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:44.003952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:44.004226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:44.005068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:44.005376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:44.007027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:44.015900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 64/125] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:44.016702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:44.023781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 62/126] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:14:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:44.024726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:44.064805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:44.106570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:44.149527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2a03d-a39c-414d-8deb-0c2afd1d0a65 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:44.200442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80cd1d-cdea-4e1f-8a8a-07afaebe34a2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:44.215837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee904ff-f702-46c1-a477-cb6c4ae5c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:44.217034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee904ff-f702-46c1-a477-cb6c4ae5c128 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:44.217528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee904ff-f702-46c1-a477-cb6c4ae5c128 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:44.217995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee904ff-f702-46c1-a477-cb6c4ae5c128 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:44.237334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee904ff-f702-46c1-a477-cb6c4ae5c128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0ee904ff-f702-46c1-a477-cb6c4ae5c128 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:44.246624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:44.247564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:44.248334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:44.256112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 65/127] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:44.259816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee904ff-f702-46c1-a477-cb6c4ae5c128 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:44.261963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d515ff-3d7d-44b4-adfe-e91c135d5feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:44.263123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d515ff-3d7d-44b4-adfe-e91c135d5feb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:44.263998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d515ff-3d7d-44b4-adfe-e91c135d5feb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:44.264839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d515ff-3d7d-44b4-adfe-e91c135d5feb None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:44.268524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d515ff-3d7d-44b4-adfe-e91c135d5feb None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:44.270312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d515ff-3d7d-44b4-adfe-e91c135d5feb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:44.273683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 63/128] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:44 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:44.274675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d515ff-3d7d-44b4-adfe-e91c135d5feb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:44.451358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee904ff-f702-46c1-a477-cb6c4ae5c128 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:44.459308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:44.463186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d515ff-3d7d-44b4-adfe-e91c135d5feb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:44.511815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065dcc-ed3f-4a18-a617-11311fab2668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:44.512722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065dcc-ed3f-4a18-a617-11311fab2668 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:44.513011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065dcc-ed3f-4a18-a617-11311fab2668 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:44.513287 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065dcc-ed3f-4a18-a617-11311fab2668 None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:44.519776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a065dcc-ed3f-4a18-a617-11311fab2668 None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:44.521255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a065dcc-ed3f-4a18-a617-11311fab2668 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:44.523588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 66/129] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:44 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:44.524453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065dcc-ed3f-4a18-a617-11311fab2668 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:44.529553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:44.529802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:44.530493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:44.530780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:44.531084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:44.531855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:44.532172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:44.533578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:44.551690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 64/130] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:44.553525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:44.694079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed2df9-1d3b-461b-becc-8f19beccf92f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:44.740629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065dcc-ed3f-4a18-a617-11311fab2668 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:44.750671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e50b-cf5f-4197-bd25-93c1b5bf3d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:44.751588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e50b-cf5f-4197-bd25-93c1b5bf3d54 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:44.751910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e50b-cf5f-4197-bd25-93c1b5bf3d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:44.752188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37e50b-cf5f-4197-bd25-93c1b5bf3d54 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:44.753393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e50b-cf5f-4197-bd25-93c1b5bf3d54 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:44.754876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37e50b-cf5f-4197-bd25-93c1b5bf3d54 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:44.756628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 65/131] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:44 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:44.759598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e50b-cf5f-4197-bd25-93c1b5bf3d54 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:44.815429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:44.852022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a36f-bb97-424b-9c2c-b1affb310205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:44.852916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a36f-bb97-424b-9c2c-b1affb310205 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:44.853203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a36f-bb97-424b-9c2c-b1affb310205 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:44.859343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458a36f-bb97-424b-9c2c-b1affb310205 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:44.860639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458a36f-bb97-424b-9c2c-b1affb310205 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:44.862136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458a36f-bb97-424b-9c2c-b1affb310205 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:44.863897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 67/132] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:44 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:44.864649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a36f-bb97-424b-9c2c-b1affb310205 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:44.864757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37e50b-cf5f-4197-bd25-93c1b5bf3d54 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:44.904469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643708-1f7f-4f70-b6c8-f881392013fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:44.905381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643708-1f7f-4f70-b6c8-f881392013fc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:44.905666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643708-1f7f-4f70-b6c8-f881392013fc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:44.905996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643708-1f7f-4f70-b6c8-f881392013fc None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:44.907348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e643708-1f7f-4f70-b6c8-f881392013fc None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:44.909252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e643708-1f7f-4f70-b6c8-f881392013fc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:44.911108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 66/133] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:44 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:44.911980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643708-1f7f-4f70-b6c8-f881392013fc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:45.031367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643708-1f7f-4f70-b6c8-f881392013fc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:45.043482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:45.067897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab34fb8-d5a0-4385-b2d0-f8739ca5ae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:45.069250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab34fb8-d5a0-4385-b2d0-f8739ca5ae78 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:45.069583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab34fb8-d5a0-4385-b2d0-f8739ca5ae78 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:45.069869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab34fb8-d5a0-4385-b2d0-f8739ca5ae78 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3/users/2628faec3f214ca38f3d8be5f4a57eb1/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:45.074189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab34fb8-d5a0-4385-b2d0-f8739ca5ae78 None admin] RBAC: Authorizing `identity:create_grant(project_id=d841afc24eab4adcbe2c3086e54770c3, user_id=2628faec3f214ca38f3d8be5f4a57eb1, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:45.075693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab34fb8-d5a0-4385-b2d0-f8739ca5ae78 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:45.080003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:45.110820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 67/134] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:14:44 2022] PUT /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3/users/2628faec3f214ca38f3d8be5f4a57eb1/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:14:45.111443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab34fb8-d5a0-4385-b2d0-f8739ca5ae78 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:45.141809 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458a36f-bb97-424b-9c2c-b1affb310205 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:45.199878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc8c4f-6c63-4f02-9223-7446ff0845e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:45.200873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc8c4f-6c63-4f02-9223-7446ff0845e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:45.201344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc8c4f-6c63-4f02-9223-7446ff0845e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:45.201685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc8c4f-6c63-4f02-9223-7446ff0845e0 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3/users/2628faec3f214ca38f3d8be5f4a57eb1/roles/ad532b5de50547a7a0f952954be2d53e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:45.211987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc8c4f-6c63-4f02-9223-7446ff0845e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d841afc24eab4adcbe2c3086e54770c3, user_id=2628faec3f214ca38f3d8be5f4a57eb1, role_id=ad532b5de50547a7a0f952954be2d53e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:45.213509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc8c4f-6c63-4f02-9223-7446ff0845e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:45.249394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 68/135] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:14:44 2022] PUT /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3/users/2628faec3f214ca38f3d8be5f4a57eb1/roles/ad532b5de50547a7a0f952954be2d53e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:14:45.325709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab34fb8-d5a0-4385-b2d0-f8739ca5ae78 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:45.371787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61809941-fcfe-4ba1-b7e7-38320a464f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:45.372701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61809941-fcfe-4ba1-b7e7-38320a464f27 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:45.372988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61809941-fcfe-4ba1-b7e7-38320a464f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:45.373265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61809941-fcfe-4ba1-b7e7-38320a464f27 None admin] PATH_INFO: `/v3/projects/7a41f5686b56474488163f77817217d8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:45.374558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61809941-fcfe-4ba1-b7e7-38320a464f27 None admin] RBAC: Authorizing `identity:get_project(project_id=7a41f5686b56474488163f77817217d8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:45.376135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61809941-fcfe-4ba1-b7e7-38320a464f27 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:45.377948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 68/136] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:45 2022] GET /identity/v3/projects/7a41f5686b56474488163f77817217d8 => generated 312 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:45.383905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc8c4f-6c63-4f02-9223-7446ff0845e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:45.502386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6287b6-5f09-4a93-b610-cf2cabd31108 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:45.502703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6287b6-5f09-4a93-b610-cf2cabd31108 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:45.502954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6287b6-5f09-4a93-b610-cf2cabd31108 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:45.504389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 69/137] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:45.512029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc2d5-49d2-4375-9cf5-341146ff951b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:45.512317 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc2d5-49d2-4375-9cf5-341146ff951b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:45.512598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc2d5-49d2-4375-9cf5-341146ff951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:45.527183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc8c4f-6c63-4f02-9223-7446ff0845e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:45.539179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bb8cc2d5-49d2-4375-9cf5-341146ff951b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:45.541140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb8cc2d5-49d2-4375-9cf5-341146ff951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:45.569155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:45.571384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:45.578835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f7fea-1289-4f1b-96cf-12d3c25005b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:45.580038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f7fea-1289-4f1b-96cf-12d3c25005b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:45.580360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f7fea-1289-4f1b-96cf-12d3c25005b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:45.583425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f7fea-1289-4f1b-96cf-12d3c25005b1 None admin] PATH_INFO: `/v3/projects/7a41f5686b56474488163f77817217d8/users/2628faec3f214ca38f3d8be5f4a57eb1/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:45.588209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f7fea-1289-4f1b-96cf-12d3c25005b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a41f5686b56474488163f77817217d8, user_id=2628faec3f214ca38f3d8be5f4a57eb1, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:45.590161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f7fea-1289-4f1b-96cf-12d3c25005b1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:45.614572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 69/138] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:14:45 2022] PUT /identity/v3/projects/7a41f5686b56474488163f77817217d8/users/2628faec3f214ca38f3d8be5f4a57eb1/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:14:45.641969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 70/139] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:45.668868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f7fea-1289-4f1b-96cf-12d3c25005b1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:45.791813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f7fea-1289-4f1b-96cf-12d3c25005b1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:45.844616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae03e2-d297-4935-9a20-c436be5e9f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:45.845869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae03e2-d297-4935-9a20-c436be5e9f4d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:45.846411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae03e2-d297-4935-9a20-c436be5e9f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:45.846898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae03e2-d297-4935-9a20-c436be5e9f4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:45.851898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae03e2-d297-4935-9a20-c436be5e9f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:45.853853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae03e2-d297-4935-9a20-c436be5e9f4d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:45.855987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 70/140] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:45.861937 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc2d5-49d2-4375-9cf5-341146ff951b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:45.987800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc2d5-49d2-4375-9cf5-341146ff951b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:46.033304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5e32d-b709-4d10-ae3e-62707b9ed6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:46.034357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e32d-b709-4d10-ae3e-62707b9ed6e4 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:46.034856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e32d-b709-4d10-ae3e-62707b9ed6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:46.035376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e32d-b709-4d10-ae3e-62707b9ed6e4 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:46.036328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5e32d-b709-4d10-ae3e-62707b9ed6e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:46.038156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5e32d-b709-4d10-ae3e-62707b9ed6e4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:46.069177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 71/141] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:14:45 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:46.071951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6d6ee-42cd-4cc0-823f-693af006c006 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:46.072471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6d6ee-42cd-4cc0-823f-693af006c006 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:46.072968 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6d6ee-42cd-4cc0-823f-693af006c006 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:46.074543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 71/142] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:46.080298 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac62a2-afcb-43b1-9932-a1150347aa5e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:46.081032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac62a2-afcb-43b1-9932-a1150347aa5e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:46.081523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac62a2-afcb-43b1-9932-a1150347aa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:46.104099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c4ac62a2-afcb-43b1-9932-a1150347aa5e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:46.105702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c4ac62a2-afcb-43b1-9932-a1150347aa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:46.112301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:46.195257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 72/143] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:46.242875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6d6ee-42cd-4cc0-823f-693af006c006 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:46.314092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:46.369458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6d6ee-42cd-4cc0-823f-693af006c006 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:46.410530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fec3f7-0e1a-4437-b4f3-f593f79f1fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:46.411442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec3f7-0e1a-4437-b4f3-f593f79f1fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:46.411895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec3f7-0e1a-4437-b4f3-f593f79f1fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:46.412175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec3f7-0e1a-4437-b4f3-f593f79f1fc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:46.423379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fec3f7-0e1a-4437-b4f3-f593f79f1fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-38fec3f7-0e1a-4437-b4f3-f593f79f1fc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:46.431530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:46.432371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:46.433113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 72/144] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:46.439033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac62a2-afcb-43b1-9932-a1150347aa5e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:46.539263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac62a2-afcb-43b1-9932-a1150347aa5e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:46.574482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970430f-f61e-4136-98e5-df7af2a641cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:46.575193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970430f-f61e-4136-98e5-df7af2a641cf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:46.575477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970430f-f61e-4136-98e5-df7af2a641cf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:46.575753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970430f-f61e-4136-98e5-df7af2a641cf None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:46.576516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970430f-f61e-4136-98e5-df7af2a641cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:46.576822 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970430f-f61e-4136-98e5-df7af2a641cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:46.578257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970430f-f61e-4136-98e5-df7af2a641cf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:46.587402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 73/145] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:46.593242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fec3f7-0e1a-4437-b4f3-f593f79f1fc1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:46.713111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fec3f7-0e1a-4437-b4f3-f593f79f1fc1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:46.733466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:46.757066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d423d8-bba5-4d2f-bffe-df4a4ca27ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:46.758043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d423d8-bba5-4d2f-bffe-df4a4ca27ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:46.758334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d423d8-bba5-4d2f-bffe-df4a4ca27ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:46.758613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d423d8-bba5-4d2f-bffe-df4a4ca27ef5 None admin] PATH_INFO: `/v3/users/b78fa3f57f2d437a9eb5fdf942c14586` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:46.759881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d423d8-bba5-4d2f-bffe-df4a4ca27ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=b78fa3f57f2d437a9eb5fdf942c14586)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:46.762544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198cd8b-6e87-4ecc-9d04-61afe3196871 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:46.762831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198cd8b-6e87-4ecc-9d04-61afe3196871 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:46.765629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198cd8b-6e87-4ecc-9d04-61afe3196871 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:46.765757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d423d8-bba5-4d2f-bffe-df4a4ca27ef5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:46.765837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 74/146] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:46.765904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 73/147] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:46 2022] GET /identity/v3/users/b78fa3f57f2d437a9eb5fdf942c14586 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:46.771412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198cd8b-6e87-4ecc-9d04-61afe3196871 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:46.775410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023721-5b7e-4d26-9a92-3c34a285645c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:46.775927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023721-5b7e-4d26-9a92-3c34a285645c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:46.776400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023721-5b7e-4d26-9a92-3c34a285645c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:46.777066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:46.794037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1f023721-5b7e-4d26-9a92-3c34a285645c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:46.795572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1f023721-5b7e-4d26-9a92-3c34a285645c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:46.869290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 74/148] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:46.895199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023721-5b7e-4d26-9a92-3c34a285645c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:46.953812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198cd8b-6e87-4ecc-9d04-61afe3196871 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:47.021002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0d821-2133-4bec-b41f-343ce4970d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:47.021830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0d821-2133-4bec-b41f-343ce4970d5d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:47.022107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0d821-2133-4bec-b41f-343ce4970d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:47.022381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0d821-2133-4bec-b41f-343ce4970d5d None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:47.023843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0d821-2133-4bec-b41f-343ce4970d5d None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:47.025335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0d821-2133-4bec-b41f-343ce4970d5d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:47.027098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 75/149] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:46 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:47.033520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0d821-2133-4bec-b41f-343ce4970d5d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:47.064978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023721-5b7e-4d26-9a92-3c34a285645c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:47.091231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:47.131642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb2c11-36b9-49ac-b3d1-4e12719fa387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:47.132639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2c11-36b9-49ac-b3d1-4e12719fa387 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:47.132922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2c11-36b9-49ac-b3d1-4e12719fa387 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:47.133196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2c11-36b9-49ac-b3d1-4e12719fa387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:47.151769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb2c11-36b9-49ac-b3d1-4e12719fa387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-38fb2c11-36b9-49ac-b3d1-4e12719fa387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:47.165698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:47.166605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:47.167399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 75/150] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:14:47.172783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:47.175272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb2c11-36b9-49ac-b3d1-4e12719fa387 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:47.226889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0d821-2133-4bec-b41f-343ce4970d5d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:47.270992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b020989-01fa-4998-a714-2fac7be20f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:47.272359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020989-01fa-4998-a714-2fac7be20f27 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:47.272620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020989-01fa-4998-a714-2fac7be20f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:47.272894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b020989-01fa-4998-a714-2fac7be20f27 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3/users/b78fa3f57f2d437a9eb5fdf942c14586/roles/9fb0a387eaf44abaa59f4cf3a9596f8c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:47.277393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b020989-01fa-4998-a714-2fac7be20f27 None admin] RBAC: Authorizing `identity:create_grant(project_id=d841afc24eab4adcbe2c3086e54770c3, user_id=b78fa3f57f2d437a9eb5fdf942c14586, role_id=9fb0a387eaf44abaa59f4cf3a9596f8c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:47.278875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b020989-01fa-4998-a714-2fac7be20f27 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:47.305613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 76/151] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:14:47 2022] PUT /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3/users/b78fa3f57f2d437a9eb5fdf942c14586/roles/9fb0a387eaf44abaa59f4cf3a9596f8c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:14:47.390229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb2c11-36b9-49ac-b3d1-4e12719fa387 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:47.434034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:47.434727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:47.435038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:47.435314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:47.436092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:47.436397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:47.437803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:47.450979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 76/152] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:47.457168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b020989-01fa-4998-a714-2fac7be20f27 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:47.580061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b020989-01fa-4998-a714-2fac7be20f27 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:47.614186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:47.625180 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a588d72-8463-4626-9826-d21dbaff8f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:47.626101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a588d72-8463-4626-9826-d21dbaff8f85 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:47.626382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a588d72-8463-4626-9826-d21dbaff8f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:47.626654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a588d72-8463-4626-9826-d21dbaff8f85 None admin] PATH_INFO: `/v3/users/aa2794a5a2cb463787b9e7bc82103b03` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:47.627989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a588d72-8463-4626-9826-d21dbaff8f85 None admin] RBAC: Authorizing `identity:get_user(user_id=aa2794a5a2cb463787b9e7bc82103b03)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:47.629621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a588d72-8463-4626-9826-d21dbaff8f85 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:47.637346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 77/153] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:47 2022] GET /identity/v3/users/aa2794a5a2cb463787b9e7bc82103b03 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:47.643158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:47.733783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:47.806400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d7aa-39dc-479f-b32b-3ad834919701 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:47.845686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15934c3-b72f-475c-8a64-d81a9cec9957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:47.846325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15934c3-b72f-475c-8a64-d81a9cec9957 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:47.846609 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15934c3-b72f-475c-8a64-d81a9cec9957 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:47.846882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15934c3-b72f-475c-8a64-d81a9cec9957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:47.923892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15934c3-b72f-475c-8a64-d81a9cec9957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:47.925369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15934c3-b72f-475c-8a64-d81a9cec9957 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:47.967318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:48.029835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 77/154] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:48.038140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a588d72-8463-4626-9826-d21dbaff8f85 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:48.147450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a588d72-8463-4626-9826-d21dbaff8f85 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:48.185248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a1afe-cc1b-4d8d-8fa0-2c3187f07429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:48.186320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1afe-cc1b-4d8d-8fa0-2c3187f07429 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:48.186594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1afe-cc1b-4d8d-8fa0-2c3187f07429 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:48.186861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1afe-cc1b-4d8d-8fa0-2c3187f07429 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:48.191740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a1afe-cc1b-4d8d-8fa0-2c3187f07429 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:48.193263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a1afe-cc1b-4d8d-8fa0-2c3187f07429 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:48.195207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 78/155] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:48 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:48.201374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15934c3-b72f-475c-8a64-d81a9cec9957 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:48.318915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15934c3-b72f-475c-8a64-d81a9cec9957 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:48.359715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3dbbd-0200-4daa-8706-44515f8bac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:48.360399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3dbbd-0200-4daa-8706-44515f8bac6d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:48.360689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3dbbd-0200-4daa-8706-44515f8bac6d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:48.361171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3dbbd-0200-4daa-8706-44515f8bac6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:48.362543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3dbbd-0200-4daa-8706-44515f8bac6d None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=d841afc24eab4adcbe2c3086e54770c3, user.id=aa2794a5a2cb463787b9e7bc82103b03) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:48.362855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3dbbd-0200-4daa-8706-44515f8bac6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:48.364349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3dbbd-0200-4daa-8706-44515f8bac6d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:48.375613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 78/156] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:48 2022] GET /identity/v3/role_assignments?user.id=aa2794a5a2cb463787b9e7bc82103b03&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:48.835473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed3c9-a23e-44d2-87ac-d8ee863cf69f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:48.835824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed3c9-a23e-44d2-87ac-d8ee863cf69f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:48.836021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ed3c9-a23e-44d2-87ac-d8ee863cf69f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:48.837412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 79/157] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:48.848614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5206a-6d03-40d9-a675-ba82c6aaf191 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:48.849278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5206a-6d03-40d9-a675-ba82c6aaf191 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:48.849278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5206a-6d03-40d9-a675-ba82c6aaf191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:48.860623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:48.875975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2ab5206a-6d03-40d9-a675-ba82c6aaf191 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:48.877173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2ab5206a-6d03-40d9-a675-ba82c6aaf191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:48.973527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 79/158] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:48.988197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108da97-0893-461b-82e9-1b741a557aaf None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:48.988497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108da97-0893-461b-82e9-1b741a557aaf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:48.988748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108da97-0893-461b-82e9-1b741a557aaf None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:48.990286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 80/159] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:48.996614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2032cc5-6322-4eb7-aaec-59603451bfd7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:48.996899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2032cc5-6322-4eb7-aaec-59603451bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:48.997173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2032cc5-6322-4eb7-aaec-59603451bfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:49.009663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108da97-0893-461b-82e9-1b741a557aaf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:49.024866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e2032cc5-6322-4eb7-aaec-59603451bfd7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:49.026056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e2032cc5-6322-4eb7-aaec-59603451bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:49.109124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 80/160] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:49.110623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4bf2b-3ddc-4db9-ba24-735ddbd602e0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:49.111228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4bf2b-3ddc-4db9-ba24-735ddbd602e0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:49.111507 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4bf2b-3ddc-4db9-ba24-735ddbd602e0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:49.113032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 81/161] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:49.118399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f176-8c39-4b77-a4df-eafff71b559d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:49.118683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f176-8c39-4b77-a4df-eafff71b559d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:49.118953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f176-8c39-4b77-a4df-eafff71b559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:49.138705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2c52f176-8c39-4b77-a4df-eafff71b559d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:49.140380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2c52f176-8c39-4b77-a4df-eafff71b559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:49.153885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:49.212108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:49.225204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 82/162] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:49.226487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f176-8c39-4b77-a4df-eafff71b559d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:49.251663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108da97-0893-461b-82e9-1b741a557aaf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:49.332800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d5113-78e4-4433-bc54-3f6e597b2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:49.333461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d5113-78e4-4433-bc54-3f6e597b2e49 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:49.333756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d5113-78e4-4433-bc54-3f6e597b2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:49.334024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d5113-78e4-4433-bc54-3f6e597b2e49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:49.339427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f176-8c39-4b77-a4df-eafff71b559d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:49.367333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d5113-78e4-4433-bc54-3f6e597b2e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:49.376770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad677b-1fa6-424e-a73e-ca62f9856934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:49.377741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad677b-1fa6-424e-a73e-ca62f9856934 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:49.378179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad677b-1fa6-424e-a73e-ca62f9856934 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:49.378598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad677b-1fa6-424e-a73e-ca62f9856934 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ed2d5113-78e4-4433-bc54-3f6e597b2e49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:49.379638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:49.380675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:49.381587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 81/163] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:14:49.382308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d5113-78e4-4433-bc54-3f6e597b2e49 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:49.397841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad677b-1fa6-424e-a73e-ca62f9856934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-20ad677b-1fa6-424e-a73e-ca62f9856934 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:49.406346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:49.407352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:49.408215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:49.410396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 83/164] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:49.411445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad677b-1fa6-424e-a73e-ca62f9856934 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:49.466439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:49.526671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad677b-1fa6-424e-a73e-ca62f9856934 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:49.597033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:49.598066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:49.598479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:49.598880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:49.599813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:49.600267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:49.601538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d5113-78e4-4433-bc54-3f6e597b2e49 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:49.602066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:49.618592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 84/165] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:49.620222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:49.676423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:49.702360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a9a7-f945-4271-b96a-6c707f16fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:49.703386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a9a7-f945-4271-b96a-6c707f16fca7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:49.703762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a9a7-f945-4271-b96a-6c707f16fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:49.704046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975a9a7-f945-4271-b96a-6c707f16fca7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:49.730014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975a9a7-f945-4271-b96a-6c707f16fca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2975a9a7-f945-4271-b96a-6c707f16fca7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:49.738307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:49.739206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:49.739978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:49.747804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 82/166] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:14:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:49.748477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a9a7-f945-4271-b96a-6c707f16fca7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:49.800595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b77815-214d-4ec2-89c1-b89045fcbf56 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:49.826808 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:49.867208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:49.868758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:49.869249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:49.869710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:49.871092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:49.871629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:49.873384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:49.900519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 85/167] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:49.901723 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:49.924685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975a9a7-f945-4271-b96a-6c707f16fca7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:50.013667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ece71-74bd-47e6-857c-80caec8b0f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:50.014579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ece71-74bd-47e6-857c-80caec8b0f18 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.014850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ece71-74bd-47e6-857c-80caec8b0f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.015150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ece71-74bd-47e6-857c-80caec8b0f18 None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.016393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ece71-74bd-47e6-857c-80caec8b0f18 None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:50.017914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ece71-74bd-47e6-857c-80caec8b0f18 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:50.019621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 83/168] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:49 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:50.020936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ece71-74bd-47e6-857c-80caec8b0f18 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:50.083423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:50.168807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aace0f-564b-4143-8b5d-f3c3fd1e1ee6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:50.172653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ece71-74bd-47e6-857c-80caec8b0f18 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:50.254350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c83e5-c4ab-4366-b5c0-e33a5de4ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:50.255064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c83e5-c4ab-4366-b5c0-e33a5de4ea48 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.255349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c83e5-c4ab-4366-b5c0-e33a5de4ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.255624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c83e5-c4ab-4366-b5c0-e33a5de4ea48 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.258408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c83e5-c4ab-4366-b5c0-e33a5de4ea48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:50.258720 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c83e5-c4ab-4366-b5c0-e33a5de4ea48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:50.260300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c83e5-c4ab-4366-b5c0-e33a5de4ea48 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:50.262566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3b1df-1e09-4f98-9636-3808a64e6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:50.263501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b1df-1e09-4f98-9636-3808a64e6c86 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.263781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b1df-1e09-4f98-9636-3808a64e6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.264050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b1df-1e09-4f98-9636-3808a64e6c86 None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.265393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3b1df-1e09-4f98-9636-3808a64e6c86 None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:50.266858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3b1df-1e09-4f98-9636-3808a64e6c86 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:50.268617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 84/169] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:50 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:50.269479 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3b1df-1e09-4f98-9636-3808a64e6c86 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:50.287917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 86/170] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:14:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:50.289657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4389c-8688-41dd-9592-7a022242e410 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.289946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4389c-8688-41dd-9592-7a022242e410 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.290227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4389c-8688-41dd-9592-7a022242e410 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.291670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 87/171] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:50.292452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4389c-8688-41dd-9592-7a022242e410 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:50.339906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:50.408822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4389c-8688-41dd-9592-7a022242e410 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:50.446018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494428d2-a322-44f8-ba1c-b802c8640759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:50.446830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494428d2-a322-44f8-ba1c-b802c8640759 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.447167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494428d2-a322-44f8-ba1c-b802c8640759 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.447427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494428d2-a322-44f8-ba1c-b802c8640759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.522220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494428d2-a322-44f8-ba1c-b802c8640759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:50.523950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494428d2-a322-44f8-ba1c-b802c8640759 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:50.536952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3b1df-1e09-4f98-9636-3808a64e6c86 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:50.591427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:50.604743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:50.641113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 88/172] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:50.642726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ddace-feee-4870-80be-40eae7613013 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.642988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ddace-feee-4870-80be-40eae7613013 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.643368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ddace-feee-4870-80be-40eae7613013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.656256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44320b-4677-4aaa-9fae-7f8c5ad81141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:50.656935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44320b-4677-4aaa-9fae-7f8c5ad81141 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.657217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44320b-4677-4aaa-9fae-7f8c5ad81141 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.657486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44320b-4677-4aaa-9fae-7f8c5ad81141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.660584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-113ddace-feee-4870-80be-40eae7613013 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:50.661787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-113ddace-feee-4870-80be-40eae7613013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:50.731219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44320b-4677-4aaa-9fae-7f8c5ad81141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:50.732631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44320b-4677-4aaa-9fae-7f8c5ad81141 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:50.733197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 89/173] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:50.734083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ddace-feee-4870-80be-40eae7613013 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:50.833983 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 85/174] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:50.834676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44320b-4677-4aaa-9fae-7f8c5ad81141 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:50.837405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:50.860958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:50.938504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44320b-4677-4aaa-9fae-7f8c5ad81141 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:50.940439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ddace-feee-4870-80be-40eae7613013 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:50.972988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a23c-a7e5-4b43-bb3e-9c85dbdd5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:50.973865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a23c-a7e5-4b43-bb3e-9c85dbdd5fdd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.974145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a23c-a7e5-4b43-bb3e-9c85dbdd5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.974415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a23c-a7e5-4b43-bb3e-9c85dbdd5fdd None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.975687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8a23c-a7e5-4b43-bb3e-9c85dbdd5fdd None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:50.977254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8a23c-a7e5-4b43-bb3e-9c85dbdd5fdd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:50.979207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 86/175] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:50 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:50.979774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a23c-a7e5-4b43-bb3e-9c85dbdd5fdd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:50.985597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46e53a-12ca-4412-a0a1-b7488acce4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:50.986682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e53a-12ca-4412-a0a1-b7488acce4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:50.987126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e53a-12ca-4412-a0a1-b7488acce4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:50.987529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e53a-12ca-4412-a0a1-b7488acce4d9 None admin] PATH_INFO: `/v3/users/2628faec3f214ca38f3d8be5f4a57eb1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:50.989357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46e53a-12ca-4412-a0a1-b7488acce4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=2628faec3f214ca38f3d8be5f4a57eb1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:50.991496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46e53a-12ca-4412-a0a1-b7488acce4d9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:50.994091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 90/176] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:50 2022] GET /identity/v3/users/2628faec3f214ca38f3d8be5f4a57eb1 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:50.996022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46e53a-12ca-4412-a0a1-b7488acce4d9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.073331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:51.084792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a23c-a7e5-4b43-bb3e-9c85dbdd5fdd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:51.116280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46e53a-12ca-4412-a0a1-b7488acce4d9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:51.118407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9998b-36db-49c7-8dcc-6a773274f780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:51.119247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9998b-36db-49c7-8dcc-6a773274f780 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.119535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9998b-36db-49c7-8dcc-6a773274f780 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.120160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9998b-36db-49c7-8dcc-6a773274f780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.130199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9998b-36db-49c7-8dcc-6a773274f780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-98c9998b-36db-49c7-8dcc-6a773274f780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:51.137955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:51.138808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:51.139664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 87/177] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:51.140334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813e05-51e7-4602-8328-e82af70e3f8c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.140614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813e05-51e7-4602-8328-e82af70e3f8c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.140890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813e05-51e7-4602-8328-e82af70e3f8c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.142139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 88/178] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:51.143215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0c83-3f0c-4d87-aad1-6d932b99f73d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.143494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0c83-3f0c-4d87-aad1-6d932b99f73d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.143764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0c83-3f0c-4d87-aad1-6d932b99f73d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.144973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 89/179] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:51.145662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef0c83-3f0c-4d87-aad1-6d932b99f73d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.156875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444537b-15bc-4401-815c-531c7e7e6793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:51.157762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444537b-15bc-4401-815c-531c7e7e6793 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.158003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444537b-15bc-4401-815c-531c7e7e6793 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.158277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444537b-15bc-4401-815c-531c7e7e6793 None admin] PATH_INFO: `/v3/projects/7a41f5686b56474488163f77817217d8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.159598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444537b-15bc-4401-815c-531c7e7e6793 None admin] RBAC: Authorizing `identity:get_project(project_id=7a41f5686b56474488163f77817217d8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:51.161037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444537b-15bc-4401-815c-531c7e7e6793 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:51.167702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 91/180] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:50 2022] GET /identity/v3/projects/7a41f5686b56474488163f77817217d8 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:51.167702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444537b-15bc-4401-815c-531c7e7e6793 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.168469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:51.257532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef0c83-3f0c-4d87-aad1-6d932b99f73d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:51.266051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444537b-15bc-4401-815c-531c7e7e6793 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:51.290394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449298a-dcc2-4b6c-9729-bdbb225dd050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:51.291102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449298a-dcc2-4b6c-9729-bdbb225dd050 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.291374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449298a-dcc2-4b6c-9729-bdbb225dd050 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.291646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449298a-dcc2-4b6c-9729-bdbb225dd050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.292486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449298a-dcc2-4b6c-9729-bdbb225dd050 None admin] RBAC: Adding query filter params (role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=d841afc24eab4adcbe2c3086e54770c3, user.id=2628faec3f214ca38f3d8be5f4a57eb1) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:51.293023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449298a-dcc2-4b6c-9729-bdbb225dd050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:51.294242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449298a-dcc2-4b6c-9729-bdbb225dd050 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:51.299957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 90/181] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:51 2022] GET /identity/v3/role_assignments?user.id=2628faec3f214ca38f3d8be5f4a57eb1&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:51.300085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d854cbc-4938-495c-bff9-b0cef1a64ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:51.300716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854cbc-4938-495c-bff9-b0cef1a64ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.301010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854cbc-4938-495c-bff9-b0cef1a64ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.301171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80fd6-e3c2-4079-8421-250e4f479320 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.301268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854cbc-4938-495c-bff9-b0cef1a64ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.301424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80fd6-e3c2-4079-8421-250e4f479320 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.301700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80fd6-e3c2-4079-8421-250e4f479320 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.302920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 91/182] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:51.303672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a80fd6-e3c2-4079-8421-250e4f479320 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.326812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:51.390476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d854cbc-4938-495c-bff9-b0cef1a64ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:51.392048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d854cbc-4938-495c-bff9-b0cef1a64ab0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:51.395242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:51.428538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a80fd6-e3c2-4079-8421-250e4f479320 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:51.467233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6306f-94d6-4297-acc0-4b177f75bd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:51.467913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6306f-94d6-4297-acc0-4b177f75bd58 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.468242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6306f-94d6-4297-acc0-4b177f75bd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.468513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6306f-94d6-4297-acc0-4b177f75bd58 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.469264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6306f-94d6-4297-acc0-4b177f75bd58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:51.469569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6306f-94d6-4297-acc0-4b177f75bd58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:51.470989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6306f-94d6-4297-acc0-4b177f75bd58 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:51.480118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 92/183] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:51.481194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe79e-42f2-458f-bdea-65dc0a356982 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.481477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe79e-42f2-458f-bdea-65dc0a356982 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.482456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe79e-42f2-458f-bdea-65dc0a356982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.499939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d06fe79e-42f2-458f-bdea-65dc0a356982 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:51.501143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d06fe79e-42f2-458f-bdea-65dc0a356982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:51.515872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 92/184] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:51.517076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420366-09b4-48cd-95fa-9973255fe411 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.517327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420366-09b4-48cd-95fa-9973255fe411 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.517525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420366-09b4-48cd-95fa-9973255fe411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.536971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a5420366-09b4-48cd-95fa-9973255fe411 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:51.538196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a5420366-09b4-48cd-95fa-9973255fe411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:51.568855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 93/185] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:51.569497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe79e-42f2-458f-bdea-65dc0a356982 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.587603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:51.614055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 93/186] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:51.614055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db27b5-aa39-4971-8e15-7cdf18306999 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.614055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db27b5-aa39-4971-8e15-7cdf18306999 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.614055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db27b5-aa39-4971-8e15-7cdf18306999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.639059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-03db27b5-aa39-4971-8e15-7cdf18306999 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:51.640266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-03db27b5-aa39-4971-8e15-7cdf18306999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:51.667118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:51.685072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe79e-42f2-458f-bdea-65dc0a356982 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:51.705904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 94/187] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:51.706740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db27b5-aa39-4971-8e15-7cdf18306999 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.733699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:51.734364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.734638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.734906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.735922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] RBAC: Adding query filter params (role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=7a41f5686b56474488163f77817217d8, user.id=2628faec3f214ca38f3d8be5f4a57eb1) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:51.736240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:51.737711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:51.743634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 94/188] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:51 2022] GET /identity/v3/role_assignments?user.id=2628faec3f214ca38f3d8be5f4a57eb1&scope.project.id=7a41f5686b56474488163f77817217d8&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:51.744268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.819036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:51.825270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db27b5-aa39-4971-8e15-7cdf18306999 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:51.857472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a516e69-5d2f-4a05-80f8-412b890b49d2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:51.865423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f257-1199-4874-b27f-21b1aa22a405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:51.866393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f257-1199-4874-b27f-21b1aa22a405 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.866673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f257-1199-4874-b27f-21b1aa22a405 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.866945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f257-1199-4874-b27f-21b1aa22a405 None admin] PATH_INFO: `/v3/users/48d7568fae62498c832e758a87ba30e9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.882996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220f257-1199-4874-b27f-21b1aa22a405 None admin] RBAC: Authorizing `identity:get_user(user_id=48d7568fae62498c832e758a87ba30e9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:51.884519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220f257-1199-4874-b27f-21b1aa22a405 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:51.890865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 95/189] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:51 2022] GET /identity/v3/users/48d7568fae62498c832e758a87ba30e9 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:51.890865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f257-1199-4874-b27f-21b1aa22a405 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.902108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995826-c8c1-48bd-84d6-98ba9d94b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:51.903022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995826-c8c1-48bd-84d6-98ba9d94b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:51.903324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995826-c8c1-48bd-84d6-98ba9d94b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:51.903599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995826-c8c1-48bd-84d6-98ba9d94b2d7 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:51.904858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8995826-c8c1-48bd-84d6-98ba9d94b2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:51.906345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8995826-c8c1-48bd-84d6-98ba9d94b2d7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:51.908119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 95/190] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:51 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:51.908972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995826-c8c1-48bd-84d6-98ba9d94b2d7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:51.920498 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.013974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f257-1199-4874-b27f-21b1aa22a405 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.023950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995826-c8c1-48bd-84d6-98ba9d94b2d7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.051028 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168952-12ac-4168-9a3e-c25ed3916070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.051844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168952-12ac-4168-9a3e-c25ed3916070 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.052115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168952-12ac-4168-9a3e-c25ed3916070 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.052380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168952-12ac-4168-9a3e-c25ed3916070 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.057045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776b011-9f24-4029-a8e4-4cc36668ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.057838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b011-9f24-4029-a8e4-4cc36668ab66 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.058112 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b011-9f24-4029-a8e4-4cc36668ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.058687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b011-9f24-4029-a8e4-4cc36668ab66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.062986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0168952-12ac-4168-9a3e-c25ed3916070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:52.065366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.070207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776b011-9f24-4029-a8e4-4cc36668ab66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c0168952-12ac-4168-9a3e-c25ed3916070 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:52.071328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:52.072215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:52.072986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 96/191] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:14:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:52.073643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168952-12ac-4168-9a3e-c25ed3916070 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b776b011-9f24-4029-a8e4-4cc36668ab66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:52.078403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:52.079473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:52.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 96/192] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:52.080938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776b011-9f24-4029-a8e4-4cc36668ab66 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.156363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.175321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168952-12ac-4168-9a3e-c25ed3916070 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.182028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776b011-9f24-4029-a8e4-4cc36668ab66 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.207870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6303f-4801-40cf-a2d7-6110281de1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.208673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6303f-4801-40cf-a2d7-6110281de1dd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.208949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6303f-4801-40cf-a2d7-6110281de1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.209217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6303f-4801-40cf-a2d7-6110281de1dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.210468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6303f-4801-40cf-a2d7-6110281de1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.211969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6303f-4801-40cf-a2d7-6110281de1dd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.213743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 97/193] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:52.214333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6303f-4801-40cf-a2d7-6110281de1dd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.214520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a631a6-a396-4c19-9054-8ca6070198e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.215266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a631a6-a396-4c19-9054-8ca6070198e6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.215544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a631a6-a396-4c19-9054-8ca6070198e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.215815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a631a6-a396-4c19-9054-8ca6070198e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.281690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.285510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a631a6-a396-4c19-9054-8ca6070198e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.287586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a631a6-a396-4c19-9054-8ca6070198e6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.315552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6303f-4801-40cf-a2d7-6110281de1dd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.349909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.350523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.350805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.351111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.351946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] RBAC: Adding query filter params (role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=d841afc24eab4adcbe2c3086e54770c3, user.id=2628faec3f214ca38f3d8be5f4a57eb1) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:52.352253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.353691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.360006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 98/194] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/role_assignments?user.id=2628faec3f214ca38f3d8be5f4a57eb1&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=ad532b5de50547a7a0f952954be2d53e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:52.360006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.392125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.397879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 97/195] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:52.398714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a631a6-a396-4c19-9054-8ca6070198e6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.489438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439be694-2022-45cc-a5ef-c3e8bb2aee3c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.506465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.510906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a631a6-a396-4c19-9054-8ca6070198e6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.529485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.530173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.530453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.530727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.532051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:52.532051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.533199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.543745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 99/196] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:52.544668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.554030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.557215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.557215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.557215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.557215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:52.557215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.557714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.568194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 98/197] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:52.569029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.632759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.659209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90943f-bebf-47b1-b9a5-f46bffe550fe None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.685183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdb8ae-c515-4558-94f6-8b5f4ad3f686 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.693905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c4662-389f-42af-86f9-5bd62053ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.694680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c4662-389f-42af-86f9-5bd62053ece0 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.695394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c4662-389f-42af-86f9-5bd62053ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.695394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c4662-389f-42af-86f9-5bd62053ece0 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.695986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c4662-389f-42af-86f9-5bd62053ece0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.697455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c4662-389f-42af-86f9-5bd62053ece0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.717755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 100/198] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:14:52 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:52.718576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c4662-389f-42af-86f9-5bd62053ece0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.719961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f881a-113b-4b82-9b34-74b9c46773a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.720854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f881a-113b-4b82-9b34-74b9c46773a4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.721160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f881a-113b-4b82-9b34-74b9c46773a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.721387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f881a-113b-4b82-9b34-74b9c46773a4 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.723529 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f881a-113b-4b82-9b34-74b9c46773a4 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.725097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f881a-113b-4b82-9b34-74b9c46773a4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.732609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 99/199] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:52.732609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f881a-113b-4b82-9b34-74b9c46773a4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.777800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.836271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c4662-389f-42af-86f9-5bd62053ece0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.862098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f881a-113b-4b82-9b34-74b9c46773a4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:52.869625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:52.878376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742279d-8b14-42b0-be8a-b23b92903fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.880193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742279d-8b14-42b0-be8a-b23b92903fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.880193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742279d-8b14-42b0-be8a-b23b92903fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.880193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742279d-8b14-42b0-be8a-b23b92903fe5 None admin] PATH_INFO: `/v3/users/48d7568fae62498c832e758a87ba30e9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.881485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742279d-8b14-42b0-be8a-b23b92903fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=48d7568fae62498c832e758a87ba30e9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.883364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742279d-8b14-42b0-be8a-b23b92903fe5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.885084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 101/200] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/users/48d7568fae62498c832e758a87ba30e9 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:52.885921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742279d-8b14-42b0-be8a-b23b92903fe5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:52.904384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ed992-b564-449b-8343-d3d99225594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:52.905279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed992-b564-449b-8343-d3d99225594c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:52.905559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed992-b564-449b-8343-d3d99225594c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:52.905829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ed992-b564-449b-8343-d3d99225594c None admin] PATH_INFO: `/v3/users/b78fa3f57f2d437a9eb5fdf942c14586` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:52.907130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ed992-b564-449b-8343-d3d99225594c None admin] RBAC: Authorizing `identity:get_user(user_id=b78fa3f57f2d437a9eb5fdf942c14586)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:52.908600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ed992-b564-449b-8343-d3d99225594c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:52.910560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 100/201] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/users/b78fa3f57f2d437a9eb5fdf942c14586 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:52.911226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ed992-b564-449b-8343-d3d99225594c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:53.016798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742279d-8b14-42b0-be8a-b23b92903fe5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:53.030224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:53.044373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ed992-b564-449b-8343-d3d99225594c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:53.062852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d566306-fe76-4826-807d-360800f44186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:53.063557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d566306-fe76-4826-807d-360800f44186 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:53.064444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d566306-fe76-4826-807d-360800f44186 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:53.064444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d566306-fe76-4826-807d-360800f44186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:53.064927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d566306-fe76-4826-807d-360800f44186 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=4b468f8138454e05acfac63b45386ffe, user.id=48d7568fae62498c832e758a87ba30e9) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:53.065235 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d566306-fe76-4826-807d-360800f44186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:53.066701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d566306-fe76-4826-807d-360800f44186 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:53.072981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 102/202] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/role_assignments?user.id=48d7568fae62498c832e758a87ba30e9&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:53.073898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d566306-fe76-4826-807d-360800f44186 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:53.085071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2be837-34ad-4225-8c72-42126b59159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:53.085770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be837-34ad-4225-8c72-42126b59159f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:53.086049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be837-34ad-4225-8c72-42126b59159f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:53.086321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be837-34ad-4225-8c72-42126b59159f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:53.167940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:53.203366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2be837-34ad-4225-8c72-42126b59159f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:53.204979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2be837-34ad-4225-8c72-42126b59159f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:53.250781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d566306-fe76-4826-807d-360800f44186 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:53.317164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb886e5f-63cc-4613-8806-e8011d4378c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:53.317835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886e5f-63cc-4613-8806-e8011d4378c6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:53.318110 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886e5f-63cc-4613-8806-e8011d4378c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:53.318379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886e5f-63cc-4613-8806-e8011d4378c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:53.392325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:53.405761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 101/203] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:53.406710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb886e5f-63cc-4613-8806-e8011d4378c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:53.408225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb886e5f-63cc-4613-8806-e8011d4378c6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:53.411313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2be837-34ad-4225-8c72-42126b59159f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:53.497401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:53.572330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2be837-34ad-4225-8c72-42126b59159f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:53.609846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d9ee-2576-4e98-95c7-25a2803399e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:53.610718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d9ee-2576-4e98-95c7-25a2803399e0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:53.611015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d9ee-2576-4e98-95c7-25a2803399e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:53.611291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1d9ee-2576-4e98-95c7-25a2803399e0 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:53.612866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1d9ee-2576-4e98-95c7-25a2803399e0 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:53.614387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1d9ee-2576-4e98-95c7-25a2803399e0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:53.614504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 103/204] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:53.616748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 102/205] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:53 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:53.620920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb886e5f-63cc-4613-8806-e8011d4378c6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:53.623894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d9ee-2576-4e98-95c7-25a2803399e0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:53.728408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:53.796242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1d9ee-2576-4e98-95c7-25a2803399e0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:53.809253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb886e5f-63cc-4613-8806-e8011d4378c6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:53.857852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:53.858750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:53.859050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:53.860123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:53.860953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] RBAC: Adding query filter params (role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=4b468f8138454e05acfac63b45386ffe, user.id=48d7568fae62498c832e758a87ba30e9) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:53.861265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:53.862743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:53.868916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 103/206] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:53 2022] GET /identity/v3/role_assignments?user.id=48d7568fae62498c832e758a87ba30e9&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=ad532b5de50547a7a0f952954be2d53e => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:53.879901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af72f31-4958-466c-ae78-d740d6ccc60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:53.880827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af72f31-4958-466c-ae78-d740d6ccc60b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:53.881112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af72f31-4958-466c-ae78-d740d6ccc60b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:53.881390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af72f31-4958-466c-ae78-d740d6ccc60b None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:53.882813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af72f31-4958-466c-ae78-d740d6ccc60b None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:53.884330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af72f31-4958-466c-ae78-d740d6ccc60b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:53.886069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 104/207] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:53 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:53.892646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:54.059331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb2437-7aea-48ac-9294-7ba37edc9afa None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:54.092226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:54.098405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b4507-84fb-42ee-b4ca-6f4c8720f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:54.099380 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4507-84fb-42ee-b4ca-6f4c8720f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:54.099861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4507-84fb-42ee-b4ca-6f4c8720f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:54.100330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4507-84fb-42ee-b4ca-6f4c8720f0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:54.101483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b4507-84fb-42ee-b4ca-6f4c8720f0b0 None admin] RBAC: Adding query filter params (role.id=9fb0a387eaf44abaa59f4cf3a9596f8c, scope.project.id=d841afc24eab4adcbe2c3086e54770c3, user.id=b78fa3f57f2d437a9eb5fdf942c14586) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:54.101997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b4507-84fb-42ee-b4ca-6f4c8720f0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:54.103701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b4507-84fb-42ee-b4ca-6f4c8720f0b0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:54.112705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 104/208] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:53 2022] GET /identity/v3/role_assignments?user.id=b78fa3f57f2d437a9eb5fdf942c14586&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=9fb0a387eaf44abaa59f4cf3a9596f8c => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:55.129940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6eacb-5aed-4cab-b313-ec3e42b0819e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.130492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6eacb-5aed-4cab-b313-ec3e42b0819e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.130492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6eacb-5aed-4cab-b313-ec3e42b0819e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.132011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 105/209] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:55.137466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecda11-afb9-4518-8595-12681e21253a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.138293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecda11-afb9-4518-8595-12681e21253a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.138840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecda11-afb9-4518-8595-12681e21253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.156424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-60ecda11-afb9-4518-8595-12681e21253a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:55.158149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-60ecda11-afb9-4518-8595-12681e21253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:55.226325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 105/210] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:55.235982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d72ca-6f5b-4134-b176-bbe7e61286e2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.236584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d72ca-6f5b-4134-b176-bbe7e61286e2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.237067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d72ca-6f5b-4134-b176-bbe7e61286e2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.238651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 106/211] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:55.244037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7459af5-a714-494a-a90a-6de51e8ff6dd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.244537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7459af5-a714-494a-a90a-6de51e8ff6dd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.245380 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7459af5-a714-494a-a90a-6de51e8ff6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.249950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d72ca-6f5b-4134-b176-bbe7e61286e2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:55.273690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e7459af5-a714-494a-a90a-6de51e8ff6dd None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:55.274877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e7459af5-a714-494a-a90a-6de51e8ff6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:55.285896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:55.347280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 106/212] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:55.356461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd291-ead1-4bad-8e93-717e64b95e63 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.356755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd291-ead1-4bad-8e93-717e64b95e63 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.357041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd291-ead1-4bad-8e93-717e64b95e63 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.358886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 107/213] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:55.364585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294b3e2-4768-45bb-b3e3-96c6beffd0bf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.364877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294b3e2-4768-45bb-b3e3-96c6beffd0bf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.365598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294b3e2-4768-45bb-b3e3-96c6beffd0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.377973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d72ca-6f5b-4134-b176-bbe7e61286e2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:55.386314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c294b3e2-4768-45bb-b3e3-96c6beffd0bf None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:55.387548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c294b3e2-4768-45bb-b3e3-96c6beffd0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:55.416646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059028-797b-4209-b2fd-032176937b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:55.417459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059028-797b-4209-b2fd-032176937b95 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.417737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059028-797b-4209-b2fd-032176937b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.418006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059028-797b-4209-b2fd-032176937b95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.428180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059028-797b-4209-b2fd-032176937b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-79059028-797b-4209-b2fd-032176937b95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:55.436084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:55.436958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:14:55.437743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:55.439332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 107/214] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:14:55.441012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059028-797b-4209-b2fd-032176937b95 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:55.448672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:55.470236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 108/215] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:55.471333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294b3e2-4768-45bb-b3e3-96c6beffd0bf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:55.555184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:55.565321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059028-797b-4209-b2fd-032176937b95 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:55.577899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294b3e2-4768-45bb-b3e3-96c6beffd0bf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:55.601695 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051ef61-fa35-421e-8c88-0bec0df2505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:55.602771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ef61-fa35-421e-8c88-0bec0df2505c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.603076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ef61-fa35-421e-8c88-0bec0df2505c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.603387 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ef61-fa35-421e-8c88-0bec0df2505c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.604577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051ef61-fa35-421e-8c88-0bec0df2505c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:55.606071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051ef61-fa35-421e-8c88-0bec0df2505c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:55.607704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 108/216] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:55.608482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051ef61-fa35-421e-8c88-0bec0df2505c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:55.622385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:55.623214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.623454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.623727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.624488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:55.624785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:55.626197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:55.637300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 109/217] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:55.638405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:55.688251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:55.729760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051ef61-fa35-421e-8c88-0bec0df2505c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:55.748135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e74d-5e6e-4797-8d46-6a9b77ec48ce None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:55.768682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f528-4ff5-40a2-a2d8-803d631069b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:55.769623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f528-4ff5-40a2-a2d8-803d631069b2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.769909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f528-4ff5-40a2-a2d8-803d631069b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.770185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f528-4ff5-40a2-a2d8-803d631069b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.782139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4f528-4ff5-40a2-a2d8-803d631069b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-61d4f528-4ff5-40a2-a2d8-803d631069b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:55.790055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:55.791034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:55.791828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 109/218] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:55.794652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38902bbf-4c13-4c56-a174-138945acad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:55.795406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38902bbf-4c13-4c56-a174-138945acad2a None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.795676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38902bbf-4c13-4c56-a174-138945acad2a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.795950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38902bbf-4c13-4c56-a174-138945acad2a None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.796663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38902bbf-4c13-4c56-a174-138945acad2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:55.797102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f528-4ff5-40a2-a2d8-803d631069b2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:55.798234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38902bbf-4c13-4c56-a174-138945acad2a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:55.830391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 110/219] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:14:55 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:55.830391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38902bbf-4c13-4c56-a174-138945acad2a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:55.830671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:55.949705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:55.952369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38902bbf-4c13-4c56-a174-138945acad2a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:55.954954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f528-4ff5-40a2-a2d8-803d631069b2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:55.993745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:55.995508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:55.995788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:55.996056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:55.996814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:55.997116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:55.998633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:55.999298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4303b-aba0-4223-af3b-8e80df8994c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.000495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4303b-aba0-4223-af3b-8e80df8994c7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.000777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4303b-aba0-4223-af3b-8e80df8994c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.001197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4303b-aba0-4223-af3b-8e80df8994c7 None admin] PATH_INFO: `/v3/users/996357be999d4f14923f6e979dd0b2a0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.007911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 111/220] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:56.013439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.017603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4303b-aba0-4223-af3b-8e80df8994c7 None admin] RBAC: Authorizing `identity:get_user(user_id=996357be999d4f14923f6e979dd0b2a0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.019166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4303b-aba0-4223-af3b-8e80df8994c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.020946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 110/221] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:55 2022] GET /identity/v3/users/996357be999d4f14923f6e979dd0b2a0 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:56.024311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe06c5-f2d2-4cc8-8e0f-52cb11b31882 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.024610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe06c5-f2d2-4cc8-8e0f-52cb11b31882 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.024886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe06c5-f2d2-4cc8-8e0f-52cb11b31882 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.026334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 111/222] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:56.030159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe06c5-f2d2-4cc8-8e0f-52cb11b31882 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.130042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.144889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbc6e-ecd5-4723-ad75-8017dbd8ea39 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.167744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe06c5-f2d2-4cc8-8e0f-52cb11b31882 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.186941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fb00f-eb0b-411c-9756-3d44fb8cfad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.187865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb00f-eb0b-411c-9756-3d44fb8cfad8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.188152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb00f-eb0b-411c-9756-3d44fb8cfad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.188423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb00f-eb0b-411c-9756-3d44fb8cfad8 None admin] PATH_INFO: `/v3/users/48d7568fae62498c832e758a87ba30e9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.189631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fb00f-eb0b-411c-9756-3d44fb8cfad8 None admin] RBAC: Authorizing `identity:get_user(user_id=48d7568fae62498c832e758a87ba30e9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.191142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fb00f-eb0b-411c-9756-3d44fb8cfad8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.192817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 112/223] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/users/48d7568fae62498c832e758a87ba30e9 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:56.194300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf063e-e1cb-48c1-8bac-9f4a2a2d090c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.194587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf063e-e1cb-48c1-8bac-9f4a2a2d090c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.194865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf063e-e1cb-48c1-8bac-9f4a2a2d090c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.208817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87da386-cb95-4326-ba9b-d602c2218104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.209482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87da386-cb95-4326-ba9b-d602c2218104 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.209792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87da386-cb95-4326-ba9b-d602c2218104 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.210067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87da386-cb95-4326-ba9b-d602c2218104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.213006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5eaf063e-e1cb-48c1-8bac-9f4a2a2d090c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:56.214198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5eaf063e-e1cb-48c1-8bac-9f4a2a2d090c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:56.244164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.292281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 113/224] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:56.293290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf063e-e1cb-48c1-8bac-9f4a2a2d090c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.299587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87da386-cb95-4326-ba9b-d602c2218104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.301084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87da386-cb95-4326-ba9b-d602c2218104 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.400294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf063e-e1cb-48c1-8bac-9f4a2a2d090c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.406273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.431150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 112/225] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:14:56.431830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87da386-cb95-4326-ba9b-d602c2218104 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.447466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d2e9-e666-4a20-9376-8a8ccfc90926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.448438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d2e9-e666-4a20-9376-8a8ccfc90926 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.448716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d2e9-e666-4a20-9376-8a8ccfc90926 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.448988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d2e9-e666-4a20-9376-8a8ccfc90926 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.450275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d2e9-e666-4a20-9376-8a8ccfc90926 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.452002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d2e9-e666-4a20-9376-8a8ccfc90926 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.453907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 114/226] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:56.459311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d2e9-e666-4a20-9376-8a8ccfc90926 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.490209 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.555258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87da386-cb95-4326-ba9b-d602c2218104 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.574837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d2e9-e666-4a20-9376-8a8ccfc90926 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.590752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b3df5-76ce-4449-b0e7-ae5a031112d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.591610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3df5-76ce-4449-b0e7-ae5a031112d4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.591885 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3df5-76ce-4449-b0e7-ae5a031112d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.592158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b3df5-76ce-4449-b0e7-ae5a031112d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.603750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b3df5-76ce-4449-b0e7-ae5a031112d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9c0b3df5-76ce-4449-b0e7-ae5a031112d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:56.611862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:56.612734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:14:56.613738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 113/227] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:56.614645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20196bfe-5f71-47db-86ca-79709b759b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.614733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b3df5-76ce-4449-b0e7-ae5a031112d4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.614799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196bfe-5f71-47db-86ca-79709b759b4f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.617909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196bfe-5f71-47db-86ca-79709b759b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.617909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196bfe-5f71-47db-86ca-79709b759b4f None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.617909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20196bfe-5f71-47db-86ca-79709b759b4f None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.618804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20196bfe-5f71-47db-86ca-79709b759b4f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.621239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 115/228] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:56.621931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20196bfe-5f71-47db-86ca-79709b759b4f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.656607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.721036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b3df5-76ce-4449-b0e7-ae5a031112d4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.729891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.736691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20196bfe-5f71-47db-86ca-79709b759b4f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.756101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761c61-bfc3-48c1-9e89-f3c481d6e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.757160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761c61-bfc3-48c1-9e89-f3c481d6e9fd None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.757506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761c61-bfc3-48c1-9e89-f3c481d6e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.757843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761c61-bfc3-48c1-9e89-f3c481d6e9fd None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe/users/48d7568fae62498c832e758a87ba30e9/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.759986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da761c61-bfc3-48c1-9e89-f3c481d6e9fd None admin] RBAC: Authorizing `identity:create_grant(project_id=4b468f8138454e05acfac63b45386ffe, user_id=48d7568fae62498c832e758a87ba30e9, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.761561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da761c61-bfc3-48c1-9e89-f3c481d6e9fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.778442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 114/229] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:14:56 2022] PUT /identity/v3/projects/4b468f8138454e05acfac63b45386ffe/users/48d7568fae62498c832e758a87ba30e9/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:14:56.779264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.780012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.780299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.780631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.781451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:56.781761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.783577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.786240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761c61-bfc3-48c1-9e89-f3c481d6e9fd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.800392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 116/230] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:56.808990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.956468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.960671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761c61-bfc3-48c1-9e89-f3c481d6e9fd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:57.007919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddf1da-707f-457a-8c79-28370f327451 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:57.010072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:57.011652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:57.011932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:57.012220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:57.013040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] RBAC: Adding query filter params (role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=4b468f8138454e05acfac63b45386ffe, user.id=996357be999d4f14923f6e979dd0b2a0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:57.013347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:57.014812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:57.027063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 115/231] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/role_assignments?user.id=996357be999d4f14923f6e979dd0b2a0&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:57.052406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3c519-b4b1-45ba-a176-3888ed95965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:57.053343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c519-b4b1-45ba-a176-3888ed95965b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:57.053675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c519-b4b1-45ba-a176-3888ed95965b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:57.053949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c519-b4b1-45ba-a176-3888ed95965b None admin] PATH_INFO: `/v3/users/48d7568fae62498c832e758a87ba30e9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:57.055264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3c519-b4b1-45ba-a176-3888ed95965b None admin] RBAC: Authorizing `identity:get_user(user_id=48d7568fae62498c832e758a87ba30e9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:57.056775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3c519-b4b1-45ba-a176-3888ed95965b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:57.058514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 117/232] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/users/48d7568fae62498c832e758a87ba30e9 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:57.064311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:57.177622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7a6d-b234-40e6-97cd-e8626cc022f6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:57.226625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8745-a2e4-4c94-be5d-317dc87d980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:57.227486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8745-a2e4-4c94-be5d-317dc87d980f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:57.227764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8745-a2e4-4c94-be5d-317dc87d980f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:57.228030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8745-a2e4-4c94-be5d-317dc87d980f None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:57.229351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c8745-a2e4-4c94-be5d-317dc87d980f None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:57.230988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c8745-a2e4-4c94-be5d-317dc87d980f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:57.232934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 116/233] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:57 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:57.239300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3c519-b4b1-45ba-a176-3888ed95965b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:57.276981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:57.371952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3c519-b4b1-45ba-a176-3888ed95965b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:57.423550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1fdae-8eb9-4ba1-a0bb-be73d0a87e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:57.424464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1fdae-8eb9-4ba1-a0bb-be73d0a87e6c None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:57.424743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1fdae-8eb9-4ba1-a0bb-be73d0a87e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:57.425019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1fdae-8eb9-4ba1-a0bb-be73d0a87e6c None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe/users/48d7568fae62498c832e758a87ba30e9/roles/ad532b5de50547a7a0f952954be2d53e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:57.427299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1fdae-8eb9-4ba1-a0bb-be73d0a87e6c None admin] RBAC: Authorizing `identity:create_grant(project_id=4b468f8138454e05acfac63b45386ffe, user_id=48d7568fae62498c832e758a87ba30e9, role_id=ad532b5de50547a7a0f952954be2d53e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:57.429616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1fdae-8eb9-4ba1-a0bb-be73d0a87e6c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:57.448933 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 118/234] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:14:57 2022] PUT /identity/v3/projects/4b468f8138454e05acfac63b45386ffe/users/48d7568fae62498c832e758a87ba30e9/roles/ad532b5de50547a7a0f952954be2d53e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:14:58.282350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b4f7-4f57-489f-80f8-6e7020c4927c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:58.282853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b4f7-4f57-489f-80f8-6e7020c4927c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:58.282853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b4f7-4f57-489f-80f8-6e7020c4927c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:58.284482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 117/235] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:58.289659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070abdc-ef89-45ee-b0f6-db757ad065e9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:58.290093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070abdc-ef89-45ee-b0f6-db757ad065e9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:58.290289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070abdc-ef89-45ee-b0f6-db757ad065e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:58.311973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0070abdc-ef89-45ee-b0f6-db757ad065e9 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:58.313189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0070abdc-ef89-45ee-b0f6-db757ad065e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:58.321852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc843fd-2e2f-4d62-8512-0794bc3e819a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:58.322141 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc843fd-2e2f-4d62-8512-0794bc3e819a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:58.322417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc843fd-2e2f-4d62-8512-0794bc3e819a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:58.324254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 118/236] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:58.329129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e541e-06c3-4eb1-af0e-1ea60c8f97c9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:58.329410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e541e-06c3-4eb1-af0e-1ea60c8f97c9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:58.329688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e541e-06c3-4eb1-af0e-1ea60c8f97c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:58.346451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cb3e541e-06c3-4eb1-af0e-1ea60c8f97c9 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:58.347675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cb3e541e-06c3-4eb1-af0e-1ea60c8f97c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:58.392687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:58.419799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 119/237] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:14:58.448000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070abdc-ef89-45ee-b0f6-db757ad065e9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:58.468384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 119/238] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:58.473163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:58.505305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e541e-06c3-4eb1-af0e-1ea60c8f97c9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:58.564770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070abdc-ef89-45ee-b0f6-db757ad065e9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:58.602636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c58fab-f447-4fa7-a536-40f99cdb6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:58.603841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58fab-f447-4fa7-a536-40f99cdb6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:58.604345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58fab-f447-4fa7-a536-40f99cdb6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:58.604828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58fab-f447-4fa7-a536-40f99cdb6bc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:58.616154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c58fab-f447-4fa7-a536-40f99cdb6bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-74c58fab-f447-4fa7-a536-40f99cdb6bc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:58.624830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:58.625748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:14:58.626528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:58.629635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 120/239] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:58.636192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c58fab-f447-4fa7-a536-40f99cdb6bc1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:58.668844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e541e-06c3-4eb1-af0e-1ea60c8f97c9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:58.715715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46b004-f06b-4f8a-9cb0-09d8195d0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:58.716553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46b004-f06b-4f8a-9cb0-09d8195d0cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:58.716838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46b004-f06b-4f8a-9cb0-09d8195d0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:58.717115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46b004-f06b-4f8a-9cb0-09d8195d0cc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:58.718347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46b004-f06b-4f8a-9cb0-09d8195d0cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:58.719854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46b004-f06b-4f8a-9cb0-09d8195d0cc0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:58.721514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 120/240] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:58.727371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46b004-f06b-4f8a-9cb0-09d8195d0cc0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:58.727761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:58.773787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:58.775110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c58fab-f447-4fa7-a536-40f99cdb6bc1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:58.841289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:58.841893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:58.842171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:58.842452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:58.843244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:58.843549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:58.844964 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:58.865105 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 121/241] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:14:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:58.871812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:58.904125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46b004-f06b-4f8a-9cb0-09d8195d0cc0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:58.971487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aecec4-d7e2-4c77-bd6e-8a21d4a39c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:58.972276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aecec4-d7e2-4c77-bd6e-8a21d4a39c3e None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:58.972551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aecec4-d7e2-4c77-bd6e-8a21d4a39c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:58.972818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aecec4-d7e2-4c77-bd6e-8a21d4a39c3e None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:58.973538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aecec4-d7e2-4c77-bd6e-8a21d4a39c3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:58.975008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aecec4-d7e2-4c77-bd6e-8a21d4a39c3e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.012717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 121/242] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:14:58 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:14:59.047132 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930099f-fbdd-47ea-bfe4-c4f81edc68b3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.101594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e89bc-20bc-4203-98f9-5d76aa013316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.102865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e89bc-20bc-4203-98f9-5d76aa013316 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.103387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e89bc-20bc-4203-98f9-5d76aa013316 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.103662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e89bc-20bc-4203-98f9-5d76aa013316 None admin] PATH_INFO: `/v3/users/59d1faa562af4fdaa3c6da3659eb77ae` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.115714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.126283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e89bc-20bc-4203-98f9-5d76aa013316 None admin] RBAC: Authorizing `identity:get_user(user_id=59d1faa562af4fdaa3c6da3659eb77ae)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.127894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e89bc-20bc-4203-98f9-5d76aa013316 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.129959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 122/243] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:58 2022] GET /identity/v3/users/59d1faa562af4fdaa3c6da3659eb77ae => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:59.135784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aecec4-d7e2-4c77-bd6e-8a21d4a39c3e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.242912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36475b9a-b839-4a49-b33c-e3aff037a414 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.243270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36475b9a-b839-4a49-b33c-e3aff037a414 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.243485 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36475b9a-b839-4a49-b33c-e3aff037a414 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.245308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 123/244] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:59.246244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.250687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883bafe-63a4-4e6d-8c14-2603caab4890 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.250994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883bafe-63a4-4e6d-8c14-2603caab4890 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.251261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883bafe-63a4-4e6d-8c14-2603caab4890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.277079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4883bafe-63a4-4e6d-8c14-2603caab4890 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:59.278297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4883bafe-63a4-4e6d-8c14-2603caab4890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:59.280518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aecec4-d7e2-4c77-bd6e-8a21d4a39c3e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.321092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d022-e0e0-4b1f-b5b0-ed5982b21afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.321750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d022-e0e0-4b1f-b5b0-ed5982b21afe None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.322020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d022-e0e0-4b1f-b5b0-ed5982b21afe None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.322297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507d022-e0e0-4b1f-b5b0-ed5982b21afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.358584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 124/245] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:14:59.383135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883bafe-63a4-4e6d-8c14-2603caab4890 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.396430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507d022-e0e0-4b1f-b5b0-ed5982b21afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.398095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507d022-e0e0-4b1f-b5b0-ed5982b21afe None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.495929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.516419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883bafe-63a4-4e6d-8c14-2603caab4890 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.526501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 122/246] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:14:59.538472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d022-e0e0-4b1f-b5b0-ed5982b21afe None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.553744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.564997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17808902-4232-4611-96bf-b8a8504b6944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.565818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17808902-4232-4611-96bf-b8a8504b6944 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.566101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17808902-4232-4611-96bf-b8a8504b6944 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.566380 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17808902-4232-4611-96bf-b8a8504b6944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.578306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17808902-4232-4611-96bf-b8a8504b6944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-17808902-4232-4611-96bf-b8a8504b6944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:59.588093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:59.589089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:14:59.589876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 125/247] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:14:59.595691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17808902-4232-4611-96bf-b8a8504b6944 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.677987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507d022-e0e0-4b1f-b5b0-ed5982b21afe None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.722937 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17808902-4232-4611-96bf-b8a8504b6944 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.724905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0016ff-ff40-4c8f-a169-d644e83f526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.727801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0016ff-ff40-4c8f-a169-d644e83f526b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.727801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0016ff-ff40-4c8f-a169-d644e83f526b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.727801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0016ff-ff40-4c8f-a169-d644e83f526b None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.729065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0016ff-ff40-4c8f-a169-d644e83f526b None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.730637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0016ff-ff40-4c8f-a169-d644e83f526b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.732489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 123/248] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:59.740686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0016ff-ff40-4c8f-a169-d644e83f526b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.769511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffbe24-9d59-4edc-ba22-bbf614129de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.770608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffbe24-9d59-4edc-ba22-bbf614129de4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.771155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffbe24-9d59-4edc-ba22-bbf614129de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.771642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffbe24-9d59-4edc-ba22-bbf614129de4 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.772676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffbe24-9d59-4edc-ba22-bbf614129de4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:59.773226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffbe24-9d59-4edc-ba22-bbf614129de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.774892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffbe24-9d59-4edc-ba22-bbf614129de4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.785588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 126/249] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:59.788229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80304bc-f9e2-46e4-8c4a-bc2f35670b4c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.788725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80304bc-f9e2-46e4-8c4a-bc2f35670b4c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.789199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80304bc-f9e2-46e4-8c4a-bc2f35670b4c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.790774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 127/250] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:59.791700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80304bc-f9e2-46e4-8c4a-bc2f35670b4c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.811634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.861100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.883276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0016ff-ff40-4c8f-a169-d644e83f526b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.928638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d17f-21cd-46cd-a0b4-ccdc39aff9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.929437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d17f-21cd-46cd-a0b4-ccdc39aff9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.929713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d17f-21cd-46cd-a0b4-ccdc39aff9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.929983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d17f-21cd-46cd-a0b4-ccdc39aff9d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.931035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d17f-21cd-46cd-a0b4-ccdc39aff9d6 None admin] RBAC: Adding query filter params (role.id=9fb0a387eaf44abaa59f4cf3a9596f8c, scope.project.id=4b468f8138454e05acfac63b45386ffe, user.id=59d1faa562af4fdaa3c6da3659eb77ae) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:59.931347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d17f-21cd-46cd-a0b4-ccdc39aff9d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.932544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80304bc-f9e2-46e4-8c4a-bc2f35670b4c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.932897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7d17f-21cd-46cd-a0b4-ccdc39aff9d6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.949641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 124/251] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/role_assignments?user.id=59d1faa562af4fdaa3c6da3659eb77ae&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=9fb0a387eaf44abaa59f4cf3a9596f8c => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:59.952490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fa5c-ae02-40c3-bb3f-28571606e3c2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.953022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fa5c-ae02-40c3-bb3f-28571606e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.954319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5fa5c-ae02-40c3-bb3f-28571606e3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.974957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-92d5fa5c-ae02-40c3-bb3f-28571606e3c2 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:59.976736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-92d5fa5c-ae02-40c3-bb3f-28571606e3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:59.979445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c7e8-2707-436e-9297-53157967f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.980374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c7e8-2707-436e-9297-53157967f696 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.980653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c7e8-2707-436e-9297-53157967f696 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.980932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c7e8-2707-436e-9297-53157967f696 None admin] PATH_INFO: `/v3/users/48d7568fae62498c832e758a87ba30e9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.983706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c7e8-2707-436e-9297-53157967f696 None admin] RBAC: Authorizing `identity:get_user(user_id=48d7568fae62498c832e758a87ba30e9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.985323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c7e8-2707-436e-9297-53157967f696 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.991040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 128/252] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/users/48d7568fae62498c832e758a87ba30e9 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:59.994236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c7e8-2707-436e-9297-53157967f696 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.059042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 125/253] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:00.081878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5fa5c-ae02-40c3-bb3f-28571606e3c2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.144202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.161272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c7e8-2707-436e-9297-53157967f696 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.223366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.242390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5fa5c-ae02-40c3-bb3f-28571606e3c2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.243768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108764-12e5-4304-8d93-d4af1cbba39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.244649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108764-12e5-4304-8d93-d4af1cbba39f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.245493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108764-12e5-4304-8d93-d4af1cbba39f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.245950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108764-12e5-4304-8d93-d4af1cbba39f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.289317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18feb1-8847-49ae-ab60-66f080a9f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.290147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18feb1-8847-49ae-ab60-66f080a9f249 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.290431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18feb1-8847-49ae-ab60-66f080a9f249 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.290694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18feb1-8847-49ae-ab60-66f080a9f249 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.310026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18feb1-8847-49ae-ab60-66f080a9f249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ab18feb1-8847-49ae-ab60-66f080a9f249 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:00.317865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:00.318722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:00.319879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:00.327369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 126/254] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:00.328611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a318f85-d4df-4aa9-876d-2d9bca1ce352 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.328933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a318f85-d4df-4aa9-876d-2d9bca1ce352 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.335070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a318f85-d4df-4aa9-876d-2d9bca1ce352 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.335070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 127/255] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:00.335070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a318f85-d4df-4aa9-876d-2d9bca1ce352 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.354302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108764-12e5-4304-8d93-d4af1cbba39f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.356376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108764-12e5-4304-8d93-d4af1cbba39f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.459801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 129/256] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:00.461929 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821e32-923c-47aa-b943-a1f473c571e4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.462411 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821e32-923c-47aa-b943-a1f473c571e4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.462874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821e32-923c-47aa-b943-a1f473c571e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.480050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-43821e32-923c-47aa-b943-a1f473c571e4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:00.481561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-43821e32-923c-47aa-b943-a1f473c571e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:00.493948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.534560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a318f85-d4df-4aa9-876d-2d9bca1ce352 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.549586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.592927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.594002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.594479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.594993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.596072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:00.596572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.598253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.598765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 130/257] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:00.599668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821e32-923c-47aa-b943-a1f473c571e4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.616477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 128/258] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:00.625832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.757209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe175ff-c1db-4603-91a8-d72464bacdcd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.761567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821e32-923c-47aa-b943-a1f473c571e4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.797441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b84ed-59de-486b-ae14-432a3dab4f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.798700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b84ed-59de-486b-ae14-432a3dab4f5f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.799225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b84ed-59de-486b-ae14-432a3dab4f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.799689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b84ed-59de-486b-ae14-432a3dab4f5f None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.801077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b84ed-59de-486b-ae14-432a3dab4f5f None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.802786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b84ed-59de-486b-ae14-432a3dab4f5f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.804332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf907d4e-e2b8-430d-bb21-fc2bf32e287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.805264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf907d4e-e2b8-430d-bb21-fc2bf32e287c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.805369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 131/259] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:00.805552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf907d4e-e2b8-430d-bb21-fc2bf32e287c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.805827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf907d4e-e2b8-430d-bb21-fc2bf32e287c None admin] PATH_INFO: `/v3/users/996357be999d4f14923f6e979dd0b2a0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.806757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b84ed-59de-486b-ae14-432a3dab4f5f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.811717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf907d4e-e2b8-430d-bb21-fc2bf32e287c None admin] RBAC: Authorizing `identity:get_user(user_id=996357be999d4f14923f6e979dd0b2a0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.813208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf907d4e-e2b8-430d-bb21-fc2bf32e287c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.814907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 129/260] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/users/996357be999d4f14923f6e979dd0b2a0 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:00.815699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf907d4e-e2b8-430d-bb21-fc2bf32e287c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.829616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.856514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.925953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf907d4e-e2b8-430d-bb21-fc2bf32e287c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.928541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b84ed-59de-486b-ae14-432a3dab4f5f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.969156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b09fc-e3f1-441e-8aab-35d302c4c478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.970354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b09fc-e3f1-441e-8aab-35d302c4c478 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.970851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b09fc-e3f1-441e-8aab-35d302c4c478 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.971375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b09fc-e3f1-441e-8aab-35d302c4c478 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.976711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.977393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.977680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.977961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.978816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=4b468f8138454e05acfac63b45386ffe, user.id=48d7568fae62498c832e758a87ba30e9) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:00.979156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.980662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.984690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b09fc-e3f1-441e-8aab-35d302c4c478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-920b09fc-e3f1-441e-8aab-35d302c4c478 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:00.993722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:00.994595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:00.995775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:00.997414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 130/261] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/role_assignments?user.id=48d7568fae62498c832e758a87ba30e9&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:00.998331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.998925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 132/262] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:01.008131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b09fc-e3f1-441e-8aab-35d302c4c478 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:01.223330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:01.236385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b09fc-e3f1-441e-8aab-35d302c4c478 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:01.244397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:01.250327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fd22c-3e16-475a-b497-78e28ebc035f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:01.296703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:01.297316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:01.297590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:01.297861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:01.298611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:01.298913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:01.300346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:01.311947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 133/263] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:01.319155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:01.324715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec990157-361a-4285-ae14-db9e5c4b0c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:01.325604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec990157-361a-4285-ae14-db9e5c4b0c64 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:01.325879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec990157-361a-4285-ae14-db9e5c4b0c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:01.326147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec990157-361a-4285-ae14-db9e5c4b0c64 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:01.328131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec990157-361a-4285-ae14-db9e5c4b0c64 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:01.329605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec990157-361a-4285-ae14-db9e5c4b0c64 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:01.331342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 131/264] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:01.344032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec990157-361a-4285-ae14-db9e5c4b0c64 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:01.479173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec990157-361a-4285-ae14-db9e5c4b0c64 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:01.526290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb000-aaf7-4291-8a6d-614e9fc42961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:01.527585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb000-aaf7-4291-8a6d-614e9fc42961 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:01.529860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb000-aaf7-4291-8a6d-614e9fc42961 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:01.530569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfb000-aaf7-4291-8a6d-614e9fc42961 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe/users/996357be999d4f14923f6e979dd0b2a0/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:01.533402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762076c-b62a-4f52-800c-580d853c52d0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:01.539796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfb000-aaf7-4291-8a6d-614e9fc42961 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b468f8138454e05acfac63b45386ffe, user_id=996357be999d4f14923f6e979dd0b2a0, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:01.541284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfb000-aaf7-4291-8a6d-614e9fc42961 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:01.572868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 132/265] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:01 2022] PUT /identity/v3/projects/4b468f8138454e05acfac63b45386ffe/users/996357be999d4f14923f6e979dd0b2a0/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:15:01.582984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6706-0272-4e8c-8d23-be10a0c5706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:01.584348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6706-0272-4e8c-8d23-be10a0c5706b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:01.584886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6706-0272-4e8c-8d23-be10a0c5706b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:01.585382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6706-0272-4e8c-8d23-be10a0c5706b None admin] PATH_INFO: `/v3/users/48d7568fae62498c832e758a87ba30e9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:01.587760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a6706-0272-4e8c-8d23-be10a0c5706b None admin] RBAC: Authorizing `identity:get_user(user_id=48d7568fae62498c832e758a87ba30e9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:01.590308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a6706-0272-4e8c-8d23-be10a0c5706b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:01.594835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 134/266] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:01 2022] GET /identity/v3/users/48d7568fae62498c832e758a87ba30e9 => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:01.601277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb000-aaf7-4291-8a6d-614e9fc42961 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:01.647867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:01.740317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfb000-aaf7-4291-8a6d-614e9fc42961 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:01.777284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f3b8-9691-496b-a4ae-d45147ca64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:01.777963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f3b8-9691-496b-a4ae-d45147ca64c5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:01.778242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f3b8-9691-496b-a4ae-d45147ca64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:01.778515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f3b8-9691-496b-a4ae-d45147ca64c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:01.850657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f3b8-9691-496b-a4ae-d45147ca64c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:01.852112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f3b8-9691-496b-a4ae-d45147ca64c5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:01.883342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:01.963046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 133/267] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:01.968361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6706-0272-4e8c-8d23-be10a0c5706b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:01.984998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:02.063104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c75611-fdde-40d8-b49f-636225ecc892 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.063436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c75611-fdde-40d8-b49f-636225ecc892 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.063651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c75611-fdde-40d8-b49f-636225ecc892 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.065027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 134/268] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:15:02.075942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3661-1bf1-47b9-ac4d-54a19cf3b802 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.076250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3661-1bf1-47b9-ac4d-54a19cf3b802 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.076490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3661-1bf1-47b9-ac4d-54a19cf3b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.093477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-965e3661-1bf1-47b9-ac4d-54a19cf3b802 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:02.094674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-965e3661-1bf1-47b9-ac4d-54a19cf3b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:02.171167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 135/269] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:02.182828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6706-0272-4e8c-8d23-be10a0c5706b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:02.188462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e3661-1bf1-47b9-ac4d-54a19cf3b802 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:02.244505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149a30-9f3d-4043-b362-125b8c2fd13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:02.246126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149a30-9f3d-4043-b362-125b8c2fd13b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.246604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149a30-9f3d-4043-b362-125b8c2fd13b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.247123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149a30-9f3d-4043-b362-125b8c2fd13b None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.251369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:02.251934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6149a30-9f3d-4043-b362-125b8c2fd13b None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:02.253704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6149a30-9f3d-4043-b362-125b8c2fd13b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:02.256089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 135/270] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:01 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:02.261709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149a30-9f3d-4043-b362-125b8c2fd13b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:02.292768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e3661-1bf1-47b9-ac4d-54a19cf3b802 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:02.328620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3b54-d690-4bdd-b1ab-b8db218007f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:02.329488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3b54-d690-4bdd-b1ab-b8db218007f9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.329810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3b54-d690-4bdd-b1ab-b8db218007f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.330082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3b54-d690-4bdd-b1ab-b8db218007f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.340925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa3b54-d690-4bdd-b1ab-b8db218007f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4ffa3b54-d690-4bdd-b1ab-b8db218007f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:02.349091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:02.349981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:02.350869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 136/271] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:02.356332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3b54-d690-4bdd-b1ab-b8db218007f9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:02.401854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:02.442872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149a30-9f3d-4043-b362-125b8c2fd13b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:02.470543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3b54-d690-4bdd-b1ab-b8db218007f9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:02.479505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8de75-33b4-4401-890c-769e1a214011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:02.480673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8de75-33b4-4401-890c-769e1a214011 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.481135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8de75-33b4-4401-890c-769e1a214011 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.481610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8de75-33b4-4401-890c-769e1a214011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.482737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8de75-33b4-4401-890c-769e1a214011 None admin] RBAC: Adding query filter params (role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=4b468f8138454e05acfac63b45386ffe, user.id=48d7568fae62498c832e758a87ba30e9) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:02.483358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8de75-33b4-4401-890c-769e1a214011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:02.485184 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8de75-33b4-4401-890c-769e1a214011 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:02.490270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:02.493704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 136/272] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:02 2022] GET /identity/v3/role_assignments?user.id=48d7568fae62498c832e758a87ba30e9&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=ad532b5de50547a7a0f952954be2d53e => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:02.495636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6de3-398f-4852-b4b9-32b502fb9fa8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.496138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6de3-398f-4852-b4b9-32b502fb9fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.496604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6de3-398f-4852-b4b9-32b502fb9fa8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.499553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 137/273] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:02.505166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24045d-5a43-4ff9-9e1e-c31db535d6ef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.505482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24045d-5a43-4ff9-9e1e-c31db535d6ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.505732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24045d-5a43-4ff9-9e1e-c31db535d6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.513886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:02.515013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.515518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.516013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.516989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:02.517497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:02.519247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:02.534341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 137/274] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:02.536976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:02.549752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9b24045d-5a43-4ff9-9e1e-c31db535d6ef None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:02.551709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b24045d-5a43-4ff9-9e1e-c31db535d6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:02.683792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d68fe7-143b-42b7-8821-938a82bf57db None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:02.722418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 138/275] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:02.725982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711afae-2dd5-4cc4-a388-f8734e390f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:02.727214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711afae-2dd5-4cc4-a388-f8734e390f61 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.727705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711afae-2dd5-4cc4-a388-f8734e390f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.728165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711afae-2dd5-4cc4-a388-f8734e390f61 None admin] PATH_INFO: `/v3/users/0b4f452ff477443cae2d826276829a66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.742785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711afae-2dd5-4cc4-a388-f8734e390f61 None admin] RBAC: Authorizing `identity:get_user(user_id=0b4f452ff477443cae2d826276829a66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:02.744584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711afae-2dd5-4cc4-a388-f8734e390f61 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:02.746913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 138/276] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:02 2022] GET /identity/v3/users/0b4f452ff477443cae2d826276829a66 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:02.751646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24045d-5a43-4ff9-9e1e-c31db535d6ef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:02.756814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711afae-2dd5-4cc4-a388-f8734e390f61 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:02.811516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:02.850592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:02.888542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711afae-2dd5-4cc4-a388-f8734e390f61 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:02.890832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24045d-5a43-4ff9-9e1e-c31db535d6ef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:02.925889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41dac0-8ae8-4900-b201-2a6cc836345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:02.926863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41dac0-8ae8-4900-b201-2a6cc836345e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.927306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41dac0-8ae8-4900-b201-2a6cc836345e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.927750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ddfc8-d018-4740-b43e-6ffd554c7406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:02.927898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41dac0-8ae8-4900-b201-2a6cc836345e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.928612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddfc8-d018-4740-b43e-6ffd554c7406 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.928893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddfc8-d018-4740-b43e-6ffd554c7406 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.929162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ddfc8-d018-4740-b43e-6ffd554c7406 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.929386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41dac0-8ae8-4900-b201-2a6cc836345e None admin] RBAC: Adding query filter params (role.id=cbefb946f31c4d86944cb79fb63e9e8a, user.id=0b4f452ff477443cae2d826276829a66, scope.system=all) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:02.929834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41dac0-8ae8-4900-b201-2a6cc836345e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:02.930306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ddfc8-d018-4740-b43e-6ffd554c7406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:02.931691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41dac0-8ae8-4900-b201-2a6cc836345e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:02.931819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ddfc8-d018-4740-b43e-6ffd554c7406 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:02.933517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 139/277] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:02.934819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b394-686f-49ac-955f-9ac66342f0a6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.935247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b394-686f-49ac-955f-9ac66342f0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.935517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b394-686f-49ac-955f-9ac66342f0a6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.936887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 140/278] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:02.941600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b394-686f-49ac-955f-9ac66342f0a6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:02.950027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 139/279] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Jul 20 15:15:02 2022] GET /identity/v3/role_assignments?user.id=0b4f452ff477443cae2d826276829a66&scope.system=all&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:02.951220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3125228-40ae-403f-93ae-852ae540db9a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:02.951506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3125228-40ae-403f-93ae-852ae540db9a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:02.951785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3125228-40ae-403f-93ae-852ae540db9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:02.976301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a3125228-40ae-403f-93ae-852ae540db9a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:02.977475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a3125228-40ae-403f-93ae-852ae540db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:03.070049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 140/280] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:03.093589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3125228-40ae-403f-93ae-852ae540db9a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:03.107247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b394-686f-49ac-955f-9ac66342f0a6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:03.144242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:03.156668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926d3c-d15e-4113-9d86-ef6578df8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:03.157532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926d3c-d15e-4113-9d86-ef6578df8745 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.157932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926d3c-d15e-4113-9d86-ef6578df8745 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.158334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926d3c-d15e-4113-9d86-ef6578df8745 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.159679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e926d3c-d15e-4113-9d86-ef6578df8745 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:03.161728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e926d3c-d15e-4113-9d86-ef6578df8745 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:03.170831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:03.190761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 141/281] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:15:02 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:03.213092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3125228-40ae-403f-93ae-852ae540db9a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:03.252062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a761-6adc-4d51-8659-c3c2698d38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:03.252807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a761-6adc-4d51-8659-c3c2698d38d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.253083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a761-6adc-4d51-8659-c3c2698d38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.253351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a761-6adc-4d51-8659-c3c2698d38d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.270663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568a761-6adc-4d51-8659-c3c2698d38d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f568a761-6adc-4d51-8659-c3c2698d38d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:03.279446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:03.281474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:03.282860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 141/282] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:03.291262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926d3c-d15e-4113-9d86-ef6578df8745 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:03.406163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926d3c-d15e-4113-9d86-ef6578df8745 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:03.443944 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:03.444627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.444952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.445170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.445919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:03.446219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:03.447649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:03.456821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 142/283] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:03.462647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a761-6adc-4d51-8659-c3c2698d38d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:03.567982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:03.578135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a761-6adc-4d51-8659-c3c2698d38d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:03.613535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a591888-7f9c-4c79-9467-c50de30eb88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:03.614440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591888-7f9c-4c79-9467-c50de30eb88a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.614723 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591888-7f9c-4c79-9467-c50de30eb88a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.615020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591888-7f9c-4c79-9467-c50de30eb88a None admin] PATH_INFO: `/v3/users/59d1faa562af4fdaa3c6da3659eb77ae` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.616314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a591888-7f9c-4c79-9467-c50de30eb88a None admin] RBAC: Authorizing `identity:get_user(user_id=59d1faa562af4fdaa3c6da3659eb77ae)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:03.617869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a591888-7f9c-4c79-9467-c50de30eb88a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:03.620322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 142/284] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:03 2022] GET /identity/v3/users/59d1faa562af4fdaa3c6da3659eb77ae => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:03.626385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:03.691386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:03.766790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69724aea-5aa4-44c1-bf60-7c5ac28f3263 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:03.819982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab4426-d8ea-4e36-b5f4-2b792533294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:03.820790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab4426-d8ea-4e36-b5f4-2b792533294f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.821074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab4426-d8ea-4e36-b5f4-2b792533294f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.821348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab4426-d8ea-4e36-b5f4-2b792533294f None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.823685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab4426-d8ea-4e36-b5f4-2b792533294f None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:03.825187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab4426-d8ea-4e36-b5f4-2b792533294f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:03.827248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 143/285] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:03 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:03.833045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a591888-7f9c-4c79-9467-c50de30eb88a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:03.983158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a591888-7f9c-4c79-9467-c50de30eb88a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.022520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677296c3-7226-4cee-b65a-76bd1a0809e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.023471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677296c3-7226-4cee-b65a-76bd1a0809e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.023749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677296c3-7226-4cee-b65a-76bd1a0809e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.024019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677296c3-7226-4cee-b65a-76bd1a0809e0 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe/users/59d1faa562af4fdaa3c6da3659eb77ae/roles/9fb0a387eaf44abaa59f4cf3a9596f8c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.032397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677296c3-7226-4cee-b65a-76bd1a0809e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b468f8138454e05acfac63b45386ffe, user_id=59d1faa562af4fdaa3c6da3659eb77ae, role_id=9fb0a387eaf44abaa59f4cf3a9596f8c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.033883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677296c3-7226-4cee-b65a-76bd1a0809e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.036443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee20806-b8f7-493f-ab75-7e745246406a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.036736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee20806-b8f7-493f-ab75-7e745246406a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.037021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee20806-b8f7-493f-ab75-7e745246406a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.038740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 144/286] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:04.043977 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400959-5a29-44d4-a9bc-7342c61ec2fd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.044261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400959-5a29-44d4-a9bc-7342c61ec2fd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.044539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400959-5a29-44d4-a9bc-7342c61ec2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.059096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 143/287] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:03 2022] PUT /identity/v3/projects/4b468f8138454e05acfac63b45386ffe/users/59d1faa562af4fdaa3c6da3659eb77ae/roles/9fb0a387eaf44abaa59f4cf3a9596f8c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:04.063553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-af400959-5a29-44d4-a9bc-7342c61ec2fd None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:04.064835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af400959-5a29-44d4-a9bc-7342c61ec2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:04.185562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 145/288] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:04.221839 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677296c3-7226-4cee-b65a-76bd1a0809e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.253245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:04.352828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677296c3-7226-4cee-b65a-76bd1a0809e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.404053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da54b0e-8752-4145-baca-5909f19ec6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.405000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da54b0e-8752-4145-baca-5909f19ec6bc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.405338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da54b0e-8752-4145-baca-5909f19ec6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.405677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da54b0e-8752-4145-baca-5909f19ec6bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.421119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da54b0e-8752-4145-baca-5909f19ec6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9da54b0e-8752-4145-baca-5909f19ec6bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:04.429027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:04.429919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:04.430722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 144/289] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:04.440166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af400959-5a29-44d4-a9bc-7342c61ec2fd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.531359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:04.549612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af400959-5a29-44d4-a9bc-7342c61ec2fd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.584088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.584798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.585082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.585358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.586118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:04.586424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.587860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.596310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 146/290] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:04.603910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da54b0e-8752-4145-baca-5909f19ec6bc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.729308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:04.749326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da54b0e-8752-4145-baca-5909f19ec6bc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.788813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47436fc-27d8-41cc-bfd9-10a65a3ae184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.789699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47436fc-27d8-41cc-bfd9-10a65a3ae184 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.789974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47436fc-27d8-41cc-bfd9-10a65a3ae184 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.790246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47436fc-27d8-41cc-bfd9-10a65a3ae184 None admin] PATH_INFO: `/v3/users/996357be999d4f14923f6e979dd0b2a0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.791456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47436fc-27d8-41cc-bfd9-10a65a3ae184 None admin] RBAC: Authorizing `identity:get_user(user_id=996357be999d4f14923f6e979dd0b2a0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.792929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47436fc-27d8-41cc-bfd9-10a65a3ae184 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.794872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 145/291] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/users/996357be999d4f14923f6e979dd0b2a0 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:04.800684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.905169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c38aa-02af-4163-947f-dd015a8d0d79 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.918379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:04.956898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0a038-900c-4c56-9925-ca6ef33420fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.957626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a038-900c-4c56-9925-ca6ef33420fc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.957912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a038-900c-4c56-9925-ca6ef33420fc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.958188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a038-900c-4c56-9925-ca6ef33420fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.054426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0a038-900c-4c56-9925-ca6ef33420fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:05.055855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0a038-900c-4c56-9925-ca6ef33420fc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:05.189437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 147/292] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:05.195380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47436fc-27d8-41cc-bfd9-10a65a3ae184 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:05.349277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47436fc-27d8-41cc-bfd9-10a65a3ae184 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:05.396514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fba1d1-0f9f-489b-a3c8-223bbd773d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:05.397426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fba1d1-0f9f-489b-a3c8-223bbd773d02 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:05.397704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fba1d1-0f9f-489b-a3c8-223bbd773d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:05.398026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fba1d1-0f9f-489b-a3c8-223bbd773d02 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.403905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fba1d1-0f9f-489b-a3c8-223bbd773d02 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:05.405514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fba1d1-0f9f-489b-a3c8-223bbd773d02 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:05.407505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 146/293] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:05 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:05.413303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0a038-900c-4c56-9925-ca6ef33420fc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:05.438830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:05.579837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0a038-900c-4c56-9925-ca6ef33420fc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:05.640850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d0191-9ee0-448b-852d-027f4d87a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:05.641429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0191-9ee0-448b-852d-027f4d87a317 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:05.641709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0191-9ee0-448b-852d-027f4d87a317 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:05.641980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0191-9ee0-448b-852d-027f4d87a317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.642826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d0191-9ee0-448b-852d-027f4d87a317 None admin] RBAC: Adding query filter params (role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=4b468f8138454e05acfac63b45386ffe, user.id=996357be999d4f14923f6e979dd0b2a0) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:05.643157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d0191-9ee0-448b-852d-027f4d87a317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:05.644625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d0191-9ee0-448b-852d-027f4d87a317 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:05.656049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 148/294] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:05 2022] GET /identity/v3/role_assignments?user.id=996357be999d4f14923f6e979dd0b2a0&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:05.788659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb491650-728b-45fa-861f-c210465a5a1f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:05.789194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb491650-728b-45fa-861f-c210465a5a1f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:05.789194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb491650-728b-45fa-861f-c210465a5a1f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.790731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 147/295] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:05.792413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ebba-d3a8-4b96-a3d0-c2a57ea7c20f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:05.792703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ebba-d3a8-4b96-a3d0-c2a57ea7c20f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:05.792978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ebba-d3a8-4b96-a3d0-c2a57ea7c20f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.794580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 149/296] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:05.800451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce230b-df2b-4143-ba2a-cdc5f4e106d0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:05.800731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce230b-df2b-4143-ba2a-cdc5f4e106d0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:05.801079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce230b-df2b-4143-ba2a-cdc5f4e106d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.804536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423df7ab-7dfc-4957-afc4-ee239528008d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:05.805034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423df7ab-7dfc-4957-afc4-ee239528008d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:05.805110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423df7ab-7dfc-4957-afc4-ee239528008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.832165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b1ce230b-df2b-4143-ba2a-cdc5f4e106d0 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:05.833390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b1ce230b-df2b-4143-ba2a-cdc5f4e106d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:05.840453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-423df7ab-7dfc-4957-afc4-ee239528008d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:05.841686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-423df7ab-7dfc-4957-afc4-ee239528008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:05.859355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:05.946563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 150/297] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:05.973781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 148/298] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:05.975920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423df7ab-7dfc-4957-afc4-ee239528008d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:05.985188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:06.007931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce230b-df2b-4143-ba2a-cdc5f4e106d0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.119209 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423df7ab-7dfc-4957-afc4-ee239528008d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.127455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce230b-df2b-4143-ba2a-cdc5f4e106d0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.153775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15c55-47ad-4050-a342-26428a542a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.154577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15c55-47ad-4050-a342-26428a542a60 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.154876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15c55-47ad-4050-a342-26428a542a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.155155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15c55-47ad-4050-a342-26428a542a60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.166087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35060f-67d4-41a3-9fe3-dc04a0718834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.167106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35060f-67d4-41a3-9fe3-dc04a0718834 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.167244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c15c55-47ad-4050-a342-26428a542a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:06.167414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35060f-67d4-41a3-9fe3-dc04a0718834 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.167654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35060f-67d4-41a3-9fe3-dc04a0718834 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d7c15c55-47ad-4050-a342-26428a542a60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:06.175210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:06.176857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 151/299] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:06.177854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920377b-0ef5-49d8-9fcf-1ff22d8082ad None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.178674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920377b-0ef5-49d8-9fcf-1ff22d8082ad None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.178674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920377b-0ef5-49d8-9fcf-1ff22d8082ad None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.179651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 152/300] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:06.184722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bdb89-5fd9-48df-bb07-c0cea371a8a4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.185283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bdb89-5fd9-48df-bb07-c0cea371a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.185283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bdb89-5fd9-48df-bb07-c0cea371a8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.188382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35060f-67d4-41a3-9fe3-dc04a0718834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ef35060f-67d4-41a3-9fe3-dc04a0718834 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:06.196565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:06.198075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 149/301] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:06.200687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35060f-67d4-41a3-9fe3-dc04a0718834 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.203963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a78bdb89-5fd9-48df-bb07-c0cea371a8a4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:06.204732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a78bdb89-5fd9-48df-bb07-c0cea371a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:06.209809 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:06.272041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:06.287274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 153/302] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:06.288292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bdb89-5fd9-48df-bb07-c0cea371a8a4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.317972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35060f-67d4-41a3-9fe3-dc04a0718834 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.353745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.354571 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.354920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.355279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.356092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:06.356462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:06.357924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:06.369477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 150/303] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:06.370661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.396425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bdb89-5fd9-48df-bb07-c0cea371a8a4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.430423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.431265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.431638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.432002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.432867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:06.433249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:06.434673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:06.447763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 154/304] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:06.447763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.449887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:06.489023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471ced9-3ba3-4449-b4fc-e05be4fad2eb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.503968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:06.525435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaa618-881b-4207-80fd-e38da7e3be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.526594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa618-881b-4207-80fd-e38da7e3be65 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.526882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa618-881b-4207-80fd-e38da7e3be65 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.527191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa618-881b-4207-80fd-e38da7e3be65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.528357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaa618-881b-4207-80fd-e38da7e3be65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:06.529848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaa618-881b-4207-80fd-e38da7e3be65 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:06.531523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 151/305] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:06.532283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaa618-881b-4207-80fd-e38da7e3be65 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.554091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbe11b-47d2-4d8f-8860-1a17af61734b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.588729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac200ce-68d9-4666-a666-6da2fd73f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.589608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac200ce-68d9-4666-a666-6da2fd73f371 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.589882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac200ce-68d9-4666-a666-6da2fd73f371 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.590151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac200ce-68d9-4666-a666-6da2fd73f371 None admin] PATH_INFO: `/v3/users/0b4f452ff477443cae2d826276829a66` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.591367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac200ce-68d9-4666-a666-6da2fd73f371 None admin] RBAC: Authorizing `identity:get_user(user_id=0b4f452ff477443cae2d826276829a66)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:06.592824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac200ce-68d9-4666-a666-6da2fd73f371 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:06.594459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 155/306] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:06 2022] GET /identity/v3/users/0b4f452ff477443cae2d826276829a66 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:06.595275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac200ce-68d9-4666-a666-6da2fd73f371 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.639276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaa618-881b-4207-80fd-e38da7e3be65 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.675215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d04945-c4aa-4332-bcc7-fa2785ad873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.676111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d04945-c4aa-4332-bcc7-fa2785ad873a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.676395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d04945-c4aa-4332-bcc7-fa2785ad873a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.676678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d04945-c4aa-4332-bcc7-fa2785ad873a None admin] PATH_INFO: `/v3/users/a5c98e0b39ae491eadc4b4ebaa105e91` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.680207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:06.691297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d04945-c4aa-4332-bcc7-fa2785ad873a None admin] RBAC: Authorizing `identity:get_user(user_id=a5c98e0b39ae491eadc4b4ebaa105e91)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:06.692803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d04945-c4aa-4332-bcc7-fa2785ad873a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:06.694534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac200ce-68d9-4666-a666-6da2fd73f371 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.694653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 152/307] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:06 2022] GET /identity/v3/users/a5c98e0b39ae491eadc4b4ebaa105e91 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:06.695847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8554-a97f-4469-8f00-aa7eff975d0b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.696135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8554-a97f-4469-8f00-aa7eff975d0b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.696412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8554-a97f-4469-8f00-aa7eff975d0b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.697669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 153/308] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:06.698396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd8554-a97f-4469-8f00-aa7eff975d0b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.725614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:06.735123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31cff3-2243-4777-914d-86572527271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.735803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31cff3-2243-4777-914d-86572527271b None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.736082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31cff3-2243-4777-914d-86572527271b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.736357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31cff3-2243-4777-914d-86572527271b None admin] PATH_INFO: `/v3/groups` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.737055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31cff3-2243-4777-914d-86572527271b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:06.738510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31cff3-2243-4777-914d-86572527271b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:06.753503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 156/309] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Jul 20 15:15:06 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:06.754415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31cff3-2243-4777-914d-86572527271b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:06.828894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd8554-a97f-4469-8f00-aa7eff975d0b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.867594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31cff3-2243-4777-914d-86572527271b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:06.875067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34043484-ea05-4321-ad5a-d726e6e1cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.875996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34043484-ea05-4321-ad5a-d726e6e1cfde None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.876250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34043484-ea05-4321-ad5a-d726e6e1cfde None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.876523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34043484-ea05-4321-ad5a-d726e6e1cfde None admin] PATH_INFO: `/v3/system/users/0b4f452ff477443cae2d826276829a66/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.878141 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34043484-ea05-4321-ad5a-d726e6e1cfde None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0b4f452ff477443cae2d826276829a66, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:06.879600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34043484-ea05-4321-ad5a-d726e6e1cfde None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:06.890132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 154/310] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Jul 20 15:15:06 2022] PUT /identity/v3/system/users/0b4f452ff477443cae2d826276829a66/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:06.899384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137def0-33dd-4889-8809-6fb97c2975f8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.899384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137def0-33dd-4889-8809-6fb97c2975f8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.899384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137def0-33dd-4889-8809-6fb97c2975f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.918542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:06.919441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:06.919628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2137def0-33dd-4889-8809-6fb97c2975f8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:06.919751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:06.919980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:06.920834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] RBAC: Adding query filter params (role.id=9fb0a387eaf44abaa59f4cf3a9596f8c, user.id=a5c98e0b39ae491eadc4b4ebaa105e91, scope.system=all) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:06.920937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2137def0-33dd-4889-8809-6fb97c2975f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:06.921143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:06.922655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:06.932448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 157/311] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Jul 20 15:15:06 2022] GET /identity/v3/role_assignments?user.id=a5c98e0b39ae491eadc4b4ebaa105e91&scope.system=all&role.id=9fb0a387eaf44abaa59f4cf3a9596f8c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:06.997306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:07.024333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 155/312] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:07.043518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:07.108128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:07.161885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf790-bdf3-4b96-b7c3-78eefd04e71c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:07.196248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0247b-174a-46a0-aa75-000548c01aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:07.197067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0247b-174a-46a0-aa75-000548c01aca None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.197348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0247b-174a-46a0-aa75-000548c01aca None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.197622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0247b-174a-46a0-aa75-000548c01aca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.208971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0247b-174a-46a0-aa75-000548c01aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1ef0247b-174a-46a0-aa75-000548c01aca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:07.216886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:07.217767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:07.218543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 158/313] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:07.224131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137def0-33dd-4889-8809-6fb97c2975f8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:07.336025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137def0-33dd-4889-8809-6fb97c2975f8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:07.376142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:07.376884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.377165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.377486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.378249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:07.378557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:07.380017 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:07.389296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 156/314] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:07.394629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0247b-174a-46a0-aa75-000548c01aca None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:07.505387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0247b-174a-46a0-aa75-000548c01aca None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:07.516542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:07.541569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e33b9-1065-40df-bb11-b4154c53da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:07.542457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e33b9-1065-40df-bb11-b4154c53da2e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.542787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e33b9-1065-40df-bb11-b4154c53da2e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.543092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e33b9-1065-40df-bb11-b4154c53da2e None admin] PATH_INFO: `/v3/users/59d1faa562af4fdaa3c6da3659eb77ae` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.544384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e33b9-1065-40df-bb11-b4154c53da2e None admin] RBAC: Authorizing `identity:get_user(user_id=59d1faa562af4fdaa3c6da3659eb77ae)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:07.545908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e33b9-1065-40df-bb11-b4154c53da2e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:07.547585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 159/315] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/users/59d1faa562af4fdaa3c6da3659eb77ae => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:07.553399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:07.604558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:07.658359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4aca6-2ea4-4338-b739-7f5c81e671cd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:07.691895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cc4b-b6f2-4a07-8f83-0c259abe5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:07.692563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cc4b-b6f2-4a07-8f83-0c259abe5065 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.692842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cc4b-b6f2-4a07-8f83-0c259abe5065 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.693112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cc4b-b6f2-4a07-8f83-0c259abe5065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.761329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78cc4b-b6f2-4a07-8f83-0c259abe5065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:07.762753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78cc4b-b6f2-4a07-8f83-0c259abe5065 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:07.810247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:07.860266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 157/316] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:07.865686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e33b9-1065-40df-bb11-b4154c53da2e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:07.973336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e33b9-1065-40df-bb11-b4154c53da2e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:08.008487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192216f8-dc6e-4656-8c10-5a0196fcde87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:08.009425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192216f8-dc6e-4656-8c10-5a0196fcde87 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.009754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192216f8-dc6e-4656-8c10-5a0196fcde87 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.010032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192216f8-dc6e-4656-8c10-5a0196fcde87 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.011568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192216f8-dc6e-4656-8c10-5a0196fcde87 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:08.013199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192216f8-dc6e-4656-8c10-5a0196fcde87 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:08.015404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 160/317] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:08.021801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cc4b-b6f2-4a07-8f83-0c259abe5065 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:08.132026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cc4b-b6f2-4a07-8f83-0c259abe5065 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:08.166840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896f332-d219-4bbc-9738-4276d929a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:08.167539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f332-d219-4bbc-9738-4276d929a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.167820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f332-d219-4bbc-9738-4276d929a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.168095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f332-d219-4bbc-9738-4276d929a5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.168935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896f332-d219-4bbc-9738-4276d929a5c5 None admin] RBAC: Adding query filter params (role.id=9fb0a387eaf44abaa59f4cf3a9596f8c, scope.project.id=4b468f8138454e05acfac63b45386ffe, user.id=59d1faa562af4fdaa3c6da3659eb77ae) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:08.169246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896f332-d219-4bbc-9738-4276d929a5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:08.170708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896f332-d219-4bbc-9738-4276d929a5c5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:08.176861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 158/318] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:08 2022] GET /identity/v3/role_assignments?user.id=59d1faa562af4fdaa3c6da3659eb77ae&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=9fb0a387eaf44abaa59f4cf3a9596f8c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:08.950958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690cbe-42e3-487f-a2d7-df939abfc5c3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.951266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690cbe-42e3-487f-a2d7-df939abfc5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.951564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690cbe-42e3-487f-a2d7-df939abfc5c3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.953114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 161/319] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:08.958205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b41e-02d4-4cbb-8138-ec2c39b0cc4d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.958666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b41e-02d4-4cbb-8138-ec2c39b0cc4d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.958739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b41e-02d4-4cbb-8138-ec2c39b0cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.977193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a141b41e-02d4-4cbb-8138-ec2c39b0cc4d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:08.978371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a141b41e-02d4-4cbb-8138-ec2c39b0cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:08.988796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.029956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d427d-40aa-4350-83fc-00f21c45c225 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.030494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d427d-40aa-4350-83fc-00f21c45c225 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.030494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d427d-40aa-4350-83fc-00f21c45c225 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.031964 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 162/320] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:09.033054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9e5a-65e2-4648-9f97-8dbf31f12a59 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.033514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9e5a-65e2-4648-9f97-8dbf31f12a59 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.033625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9e5a-65e2-4648-9f97-8dbf31f12a59 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.034945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 163/321] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:09.037359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031f81-7bd1-4c79-ac8e-4377cc28a47f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.037905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031f81-7bd1-4c79-ac8e-4377cc28a47f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.038386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031f81-7bd1-4c79-ac8e-4377cc28a47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.052938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 159/322] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:09.054292 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561f1f5-bb35-468d-a73c-aef52d31b245 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.054575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561f1f5-bb35-468d-a73c-aef52d31b245 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.054854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561f1f5-bb35-468d-a73c-aef52d31b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.055661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7a031f81-7bd1-4c79-ac8e-4377cc28a47f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:09.056844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7a031f81-7bd1-4c79-ac8e-4377cc28a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:09.070565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1561f1f5-bb35-468d-a73c-aef52d31b245 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:09.071752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1561f1f5-bb35-468d-a73c-aef52d31b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:09.099021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.123825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 164/323] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:09.124546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031f81-7bd1-4c79-ac8e-4377cc28a47f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.137396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 160/324] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:09.147160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561f1f5-bb35-468d-a73c-aef52d31b245 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.220701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.229454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031f81-7bd1-4c79-ac8e-4377cc28a47f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.245530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561f1f5-bb35-468d-a73c-aef52d31b245 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.264898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4853-2481-4a4e-9a86-b5a1c89c4519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.265874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4853-2481-4a4e-9a86-b5a1c89c4519 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.266173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4853-2481-4a4e-9a86-b5a1c89c4519 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.266448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4853-2481-4a4e-9a86-b5a1c89c4519 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.268037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb4853-2481-4a4e-9a86-b5a1c89c4519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.269758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb4853-2481-4a4e-9a86-b5a1c89c4519 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.271591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 165/325] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:09.272467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4853-2481-4a4e-9a86-b5a1c89c4519 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.286841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b6a42-906e-472e-9261-703241784198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.288102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b6a42-906e-472e-9261-703241784198 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.288384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b6a42-906e-472e-9261-703241784198 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.288658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b6a42-906e-472e-9261-703241784198 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.299512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b6a42-906e-472e-9261-703241784198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-034b6a42-906e-472e-9261-703241784198 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:09.307430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:09.308491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:09.309315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 161/326] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:09.309962 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b6a42-906e-472e-9261-703241784198 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.328387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.384114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4853-2481-4a4e-9a86-b5a1c89c4519 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.410147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b6a42-906e-472e-9261-703241784198 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.417877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a677-f9f2-4ea9-a1bc-31dd7fbf3a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.418696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a677-f9f2-4ea9-a1bc-31dd7fbf3a1a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.418995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a677-f9f2-4ea9-a1bc-31dd7fbf3a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.419265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a677-f9f2-4ea9-a1bc-31dd7fbf3a1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.430376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a677-f9f2-4ea9-a1bc-31dd7fbf3a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8815a677-f9f2-4ea9-a1bc-31dd7fbf3a1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:09.438197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:09.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:09.439881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 166/327] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:09.440527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a677-f9f2-4ea9-a1bc-31dd7fbf3a1a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.444026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9dff4-60bb-4603-808c-a0164b20d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.444836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9dff4-60bb-4603-808c-a0164b20d09e None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.445119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9dff4-60bb-4603-808c-a0164b20d09e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.445391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9dff4-60bb-4603-808c-a0164b20d09e None admin] PATH_INFO: `/v3/groups` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.446075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9dff4-60bb-4603-808c-a0164b20d09e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.447594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9dff4-60bb-4603-808c-a0164b20d09e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.450656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.463049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 162/328] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Jul 20 15:15:09 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:09.463855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9dff4-60bb-4603-808c-a0164b20d09e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.568935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a677-f9f2-4ea9-a1bc-31dd7fbf3a1a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.572138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.584742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9dff4-60bb-4603-808c-a0164b20d09e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.609236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.609904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.610182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.610449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.611232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:09.611535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.612995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.627334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 167/329] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:09.627509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.627509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.627509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.627509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.627793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:09.627793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.628184 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.628311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.638773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 163/330] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:09.645712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.722488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.757531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d5dcb-5dc9-46a0-97c0-03dfb4882d83 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.770187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eda978-8d3e-40f8-b68e-ecee5ddadb47 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.799757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80db329-354a-4b92-80d4-32be62e720eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.801112 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db329-354a-4b92-80d4-32be62e720eb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.801399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db329-354a-4b92-80d4-32be62e720eb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.801674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db329-354a-4b92-80d4-32be62e720eb None admin] PATH_INFO: `/v3/users/0b4f452ff477443cae2d826276829a66` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.803319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80db329-354a-4b92-80d4-32be62e720eb None admin] RBAC: Authorizing `identity:get_user(user_id=0b4f452ff477443cae2d826276829a66)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.804928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80db329-354a-4b92-80d4-32be62e720eb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.806832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 168/331] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/users/0b4f452ff477443cae2d826276829a66 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:09.810362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810e85-a35e-4071-b977-d7c0c3b04aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.811377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810e85-a35e-4071-b977-d7c0c3b04aed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.811657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810e85-a35e-4071-b977-d7c0c3b04aed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.811933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52810e85-a35e-4071-b977-d7c0c3b04aed None admin] PATH_INFO: `/v3/users/a5c98e0b39ae491eadc4b4ebaa105e91` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.812612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80db329-354a-4b92-80d4-32be62e720eb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.813164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52810e85-a35e-4071-b977-d7c0c3b04aed None admin] RBAC: Authorizing `identity:get_user(user_id=a5c98e0b39ae491eadc4b4ebaa105e91)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.814728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52810e85-a35e-4071-b977-d7c0c3b04aed None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.816763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 164/332] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/users/a5c98e0b39ae491eadc4b4ebaa105e91 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:09.824742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810e85-a35e-4071-b977-d7c0c3b04aed None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.861215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.950282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80db329-354a-4b92-80d4-32be62e720eb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.956616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52810e85-a35e-4071-b977-d7c0c3b04aed None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.983396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.997357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866122ee-954c-4fa5-a30d-ddc06831a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.998341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc7a6c-449f-405d-90aa-b663cd84b6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.998656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866122ee-954c-4fa5-a30d-ddc06831a030 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.999146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866122ee-954c-4fa5-a30d-ddc06831a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.999320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7a6c-449f-405d-90aa-b663cd84b6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.999695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7a6c-449f-405d-90aa-b663cd84b6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.999849 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866122ee-954c-4fa5-a30d-ddc06831a030 None admin] PATH_INFO: `/v3/system/users/a5c98e0b39ae491eadc4b4ebaa105e91/roles/9fb0a387eaf44abaa59f4cf3a9596f8c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:10.000178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc7a6c-449f-405d-90aa-b663cd84b6b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:10.001187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc7a6c-449f-405d-90aa-b663cd84b6b4 None admin] RBAC: Adding query filter params (role.id=cbefb946f31c4d86944cb79fb63e9e8a, user.id=0b4f452ff477443cae2d826276829a66, scope.system=all) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:10.001593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc7a6c-449f-405d-90aa-b663cd84b6b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:10.002034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866122ee-954c-4fa5-a30d-ddc06831a030 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a5c98e0b39ae491eadc4b4ebaa105e91, role_id=9fb0a387eaf44abaa59f4cf3a9596f8c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:10.003266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc7a6c-449f-405d-90aa-b663cd84b6b4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:10.003806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866122ee-954c-4fa5-a30d-ddc06831a030 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:10.012666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 165/333] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Jul 20 15:15:09 2022] PUT /identity/v3/system/users/a5c98e0b39ae491eadc4b4ebaa105e91/roles/9fb0a387eaf44abaa59f4cf3a9596f8c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:10.025706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 169/334] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/role_assignments?user.id=0b4f452ff477443cae2d826276829a66&scope.system=all&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:11.888513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed532-a0d5-41ee-9409-c116876eb17a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:11.889543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed532-a0d5-41ee-9409-c116876eb17a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:11.890055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ed532-a0d5-41ee-9409-c116876eb17a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:11.891930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 166/335] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:11.898192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83fc1-2891-495b-a015-67195cd83b4f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:11.899099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83fc1-2891-495b-a015-67195cd83b4f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:11.899577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83fc1-2891-495b-a015-67195cd83b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:11.923293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-88a83fc1-2891-495b-a015-67195cd83b4f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:11.924870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-88a83fc1-2891-495b-a015-67195cd83b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:12.013650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 170/336] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:12.051647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ed532-a0d5-41ee-9409-c116876eb17a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.160561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701b766-e89d-484a-aa53-1955ec1c8398 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.160748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701b766-e89d-484a-aa53-1955ec1c8398 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.161039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701b766-e89d-484a-aa53-1955ec1c8398 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.164832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 171/337] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:12.170946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18529b10-a90a-4ee7-8418-ee155415fbc1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.171263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18529b10-a90a-4ee7-8418-ee155415fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.171546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18529b10-a90a-4ee7-8418-ee155415fbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.183516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ed532-a0d5-41ee-9409-c116876eb17a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.196843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-18529b10-a90a-4ee7-8418-ee155415fbc1 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:12.202988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-18529b10-a90a-4ee7-8418-ee155415fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:12.245340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.264334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19817d2e-ded2-4287-bb4c-7448ffea06c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.265556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19817d2e-ded2-4287-bb4c-7448ffea06c4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.266024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19817d2e-ded2-4287-bb4c-7448ffea06c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.266501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19817d2e-ded2-4287-bb4c-7448ffea06c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.296033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19817d2e-ded2-4287-bb4c-7448ffea06c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-19817d2e-ded2-4287-bb4c-7448ffea06c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:12.304818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:12.305724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:12.306500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 167/338] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:12.312767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19817d2e-ded2-4287-bb4c-7448ffea06c4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.358756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 172/339] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:12.401835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18529b10-a90a-4ee7-8418-ee155415fbc1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.402415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.486664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19817d2e-ded2-4287-bb4c-7448ffea06c4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.563694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59936df7-f53b-4133-a407-ea37323f9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.564401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59936df7-f53b-4133-a407-ea37323f9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.564684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59936df7-f53b-4133-a407-ea37323f9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.564959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59936df7-f53b-4133-a407-ea37323f9ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.567756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59936df7-f53b-4133-a407-ea37323f9ea8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:12.567756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59936df7-f53b-4133-a407-ea37323f9ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:12.567756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59936df7-f53b-4133-a407-ea37323f9ea8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:12.576878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 168/340] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:12.578804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcfeba-8bc7-4f79-beb8-cd58b0864018 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.579264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcfeba-8bc7-4f79-beb8-cd58b0864018 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.579753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcfeba-8bc7-4f79-beb8-cd58b0864018 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.581510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 169/341] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:12.582844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcfeba-8bc7-4f79-beb8-cd58b0864018 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.595843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18529b10-a90a-4ee7-8418-ee155415fbc1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.642592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c1b79-df2b-4729-8cd5-99261e8d3173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.643696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c1b79-df2b-4729-8cd5-99261e8d3173 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.643982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c1b79-df2b-4729-8cd5-99261e8d3173 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.644256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c1b79-df2b-4729-8cd5-99261e8d3173 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.660481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c1b79-df2b-4729-8cd5-99261e8d3173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-422c1b79-df2b-4729-8cd5-99261e8d3173 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:12.669320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:12.670218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:12.671492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:12.675427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 173/342] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:12.676974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c649c-a8fb-442a-a100-455f191ebda6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.677262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c649c-a8fb-442a-a100-455f191ebda6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.677543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c649c-a8fb-442a-a100-455f191ebda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.708867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6c0c649c-a8fb-442a-a100-455f191ebda6 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:12.710463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c0c649c-a8fb-442a-a100-455f191ebda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:12.718921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.752714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcfeba-8bc7-4f79-beb8-cd58b0864018 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.771334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.788466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 174/343] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:12.789123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c649c-a8fb-442a-a100-455f191ebda6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.816238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a82eb2-7872-40e2-a951-1571e774b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.816902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a82eb2-7872-40e2-a951-1571e774b337 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.817180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a82eb2-7872-40e2-a951-1571e774b337 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.817451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a82eb2-7872-40e2-a951-1571e774b337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.927356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a82eb2-7872-40e2-a951-1571e774b337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:12.928989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a82eb2-7872-40e2-a951-1571e774b337 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:12.958887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c649c-a8fb-442a-a100-455f191ebda6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.995427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.996100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.996531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.996948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.997972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:12.998409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.000195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.009641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 175/344] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:13.010676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.046578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 170/345] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:13.048913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb261e09-1821-4681-b958-c699409e64f7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.049340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb261e09-1821-4681-b958-c699409e64f7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.049748 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb261e09-1821-4681-b958-c699409e64f7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.051009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.052847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 171/346] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:13.054317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb261e09-1821-4681-b958-c699409e64f7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.091341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.144537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d584d3-5fbd-444d-8b01-13a645887af3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.182105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb261e09-1821-4681-b958-c699409e64f7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.198522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a3162-90a2-472f-9f8d-e70881089bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.199896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3162-90a2-472f-9f8d-e70881089bcb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.200380 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3162-90a2-472f-9f8d-e70881089bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.200849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3162-90a2-472f-9f8d-e70881089bcb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.215418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a3162-90a2-472f-9f8d-e70881089bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:13.221354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fec2f-cc9f-402f-ad9c-6c2f33c77f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.222112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fec2f-cc9f-402f-ad9c-6c2f33c77f63 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.222389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fec2f-cc9f-402f-ad9c-6c2f33c77f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.222661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fec2f-cc9f-402f-ad9c-6c2f33c77f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d82a3162-90a2-472f-9f8d-e70881089bcb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:13.229673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:13.230671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:15:13.231862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:13.237627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 176/347] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:13.239273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a3162-90a2-472f-9f8d-e70881089bcb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.302936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fec2f-cc9f-402f-ad9c-6c2f33c77f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.304484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fec2f-cc9f-402f-ad9c-6c2f33c77f63 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.318917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.335383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.365634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a3162-90a2-472f-9f8d-e70881089bcb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.404150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22905507-b356-49bc-b3e6-c85f8c257918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.405208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22905507-b356-49bc-b3e6-c85f8c257918 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.405614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22905507-b356-49bc-b3e6-c85f8c257918 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.405993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22905507-b356-49bc-b3e6-c85f8c257918 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.407381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22905507-b356-49bc-b3e6-c85f8c257918 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.408988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22905507-b356-49bc-b3e6-c85f8c257918 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.410810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 177/348] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:13.412083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b1198-6fb4-4464-bf29-e62876825f0a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.416932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b1198-6fb4-4464-bf29-e62876825f0a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.417332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b1198-6fb4-4464-bf29-e62876825f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.434584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 172/349] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:13.435489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fec2f-cc9f-402f-ad9c-6c2f33c77f63 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.438629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-869b1198-6fb4-4464-bf29-e62876825f0a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:13.439869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-869b1198-6fb4-4464-bf29-e62876825f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:13.519700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 178/350] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:13.520579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b1198-6fb4-4464-bf29-e62876825f0a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.574361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fec2f-cc9f-402f-ad9c-6c2f33c77f63 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.588079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.609510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.618047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.618743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.619044 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.619319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.620442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:13.620898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.623306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.634504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 173/351] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:13.634504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.662789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b1198-6fb4-4464-bf29-e62876825f0a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.707220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88479d6-97dd-46b3-a3bb-8052a4a3d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.708834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88479d6-97dd-46b3-a3bb-8052a4a3d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.709353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88479d6-97dd-46b3-a3bb-8052a4a3d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.709823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88479d6-97dd-46b3-a3bb-8052a4a3d6f7 None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.717891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88479d6-97dd-46b3-a3bb-8052a4a3d6f7 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.719918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88479d6-97dd-46b3-a3bb-8052a4a3d6f7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.721863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 179/352] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:13.728313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88479d6-97dd-46b3-a3bb-8052a4a3d6f7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.757936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39711bec-8ddd-4877-835f-fafd0aa222a3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.800886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a66ab8-c4ad-4f7a-a464-7d86113a8a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.801812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66ab8-c4ad-4f7a-a464-7d86113a8a63 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.802092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66ab8-c4ad-4f7a-a464-7d86113a8a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.802366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66ab8-c4ad-4f7a-a464-7d86113a8a63 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.803715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a66ab8-c4ad-4f7a-a464-7d86113a8a63 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.805902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a66ab8-c4ad-4f7a-a464-7d86113a8a63 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.807998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 174/353] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:13.809062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a66ab8-c4ad-4f7a-a464-7d86113a8a63 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.854471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88479d6-97dd-46b3-a3bb-8052a4a3d6f7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.864354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.905025 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d8eb-fb16-4c81-8caf-e6005d11b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.905879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d8eb-fb16-4c81-8caf-e6005d11b04e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.906159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d8eb-fb16-4c81-8caf-e6005d11b04e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.906427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0d8eb-fb16-4c81-8caf-e6005d11b04e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.907274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.923195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0d8eb-fb16-4c81-8caf-e6005d11b04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fde0d8eb-fb16-4c81-8caf-e6005d11b04e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:13.933827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:13.934751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:13.935606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 180/354] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:13.936768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d8eb-fb16-4c81-8caf-e6005d11b04e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.960987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a66ab8-c4ad-4f7a-a464-7d86113a8a63 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:14.004555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b806e-dc86-4a52-a740-06c2ffe7f006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:14.005473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b806e-dc86-4a52-a740-06c2ffe7f006 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.005755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b806e-dc86-4a52-a740-06c2ffe7f006 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.006031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b806e-dc86-4a52-a740-06c2ffe7f006 None admin] PATH_INFO: `/v3/users/a5c98e0b39ae491eadc4b4ebaa105e91` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.007795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b806e-dc86-4a52-a740-06c2ffe7f006 None admin] RBAC: Authorizing `identity:get_user(user_id=a5c98e0b39ae491eadc4b4ebaa105e91)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:14.009873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b806e-dc86-4a52-a740-06c2ffe7f006 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:14.011994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 175/355] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/users/a5c98e0b39ae491eadc4b4ebaa105e91 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:14.012924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b806e-dc86-4a52-a740-06c2ffe7f006 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:14.091207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0d8eb-fb16-4c81-8caf-e6005d11b04e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:14.139191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b806e-dc86-4a52-a740-06c2ffe7f006 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:14.139465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:14.140311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.140590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.140867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.141707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] RBAC: Adding query filter params (group.id=3f4420ce62f4439d96761c87846cde42, role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=d841afc24eab4adcbe2c3086e54770c3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:14.142014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:14.145219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:14.151621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 181/356] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/role_assignments?group.id=3f4420ce62f4439d96761c87846cde42&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=ad532b5de50547a7a0f952954be2d53e => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:14.152447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:14.159545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:14.205429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97c6ea-f189-4aaf-9122-3a47f73a873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:14.206328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c6ea-f189-4aaf-9122-3a47f73a873a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.206880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c6ea-f189-4aaf-9122-3a47f73a873a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.207298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c6ea-f189-4aaf-9122-3a47f73a873a None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.209700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97c6ea-f189-4aaf-9122-3a47f73a873a None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:14.211244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97c6ea-f189-4aaf-9122-3a47f73a873a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:14.212979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 176/357] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:14 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:14.214996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04448-6acc-407d-b54d-2d19b5bfd816 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.216813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04448-6acc-407d-b54d-2d19b5bfd816 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.217097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04448-6acc-407d-b54d-2d19b5bfd816 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.219027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 177/358] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:14.219817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04448-6acc-407d-b54d-2d19b5bfd816 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:14.230241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:14.299927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ada58-a544-4efe-a08c-f7f1e190a75e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:14.345420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc16bd-046e-489a-98f2-6204f058d10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:14.346107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc16bd-046e-489a-98f2-6204f058d10f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.346395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc16bd-046e-489a-98f2-6204f058d10f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.346664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc16bd-046e-489a-98f2-6204f058d10f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.347452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc16bd-046e-489a-98f2-6204f058d10f None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:14.347754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc16bd-046e-489a-98f2-6204f058d10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:14.349168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc16bd-046e-489a-98f2-6204f058d10f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:14.361965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 182/359] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:14.363686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9607698-62f6-4a1a-9e69-bd3453abb7a9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.363965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9607698-62f6-4a1a-9e69-bd3453abb7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.364260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9607698-62f6-4a1a-9e69-bd3453abb7a9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.366520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 183/360] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:14.367264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9607698-62f6-4a1a-9e69-bd3453abb7a9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:14.367382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04448-6acc-407d-b54d-2d19b5bfd816 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:14.409013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf3f34-f0ae-46c1-843a-ff6276663e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:14.410220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf3f34-f0ae-46c1-843a-ff6276663e93 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.410711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf3f34-f0ae-46c1-843a-ff6276663e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.411222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf3f34-f0ae-46c1-843a-ff6276663e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.412572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf3f34-f0ae-46c1-843a-ff6276663e93 None admin] RBAC: Adding query filter params (role.id=9fb0a387eaf44abaa59f4cf3a9596f8c, user.id=a5c98e0b39ae491eadc4b4ebaa105e91, scope.system=all) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:14.412890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf3f34-f0ae-46c1-843a-ff6276663e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:14.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf3f34-f0ae-46c1-843a-ff6276663e93 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:14.427490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 178/361] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Jul 20 15:15:14 2022] GET /identity/v3/role_assignments?user.id=a5c98e0b39ae491eadc4b4ebaa105e91&scope.system=all&role.id=9fb0a387eaf44abaa59f4cf3a9596f8c => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:14.428804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95adf2-2566-47b9-a5b3-8ef2dfec9403 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.429085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95adf2-2566-47b9-a5b3-8ef2dfec9403 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.429509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95adf2-2566-47b9-a5b3-8ef2dfec9403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.456009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dd95adf2-2566-47b9-a5b3-8ef2dfec9403 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:14.457256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd95adf2-2566-47b9-a5b3-8ef2dfec9403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:14.489366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:14.497348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9607698-62f6-4a1a-9e69-bd3453abb7a9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:14.512396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:14.538092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b173cd-a655-43f0-81a2-379e31f245a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:14.538819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 179/362] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:14.539419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b173cd-a655-43f0-81a2-379e31f245a8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.539820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95adf2-2566-47b9-a5b3-8ef2dfec9403 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:14.540134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b173cd-a655-43f0-81a2-379e31f245a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.540611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b173cd-a655-43f0-81a2-379e31f245a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.541686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b173cd-a655-43f0-81a2-379e31f245a8 None admin] RBAC: Adding query filter params (group.id=3f4420ce62f4439d96761c87846cde42, role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=d841afc24eab4adcbe2c3086e54770c3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:14.542227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b173cd-a655-43f0-81a2-379e31f245a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:14.544115 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b173cd-a655-43f0-81a2-379e31f245a8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:14.550783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 184/363] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:14 2022] GET /identity/v3/role_assignments?group.id=3f4420ce62f4439d96761c87846cde42&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:14.552391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5394-c711-4e8f-8de3-06008decd392 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.552913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5394-c711-4e8f-8de3-06008decd392 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.553490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff5394-c711-4e8f-8de3-06008decd392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.571812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dfff5394-c711-4e8f-8de3-06008decd392 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:14.573382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dfff5394-c711-4e8f-8de3-06008decd392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:14.657969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 185/364] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:14.659253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff5394-c711-4e8f-8de3-06008decd392 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:14.757885 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95adf2-2566-47b9-a5b3-8ef2dfec9403 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:14.785134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff5394-c711-4e8f-8de3-06008decd392 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:14.797127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:14.812711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fdba1-696e-494a-854d-7e0969cc1197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:14.814201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fdba1-696e-494a-854d-7e0969cc1197 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.814394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fdba1-696e-494a-854d-7e0969cc1197 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.814769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fdba1-696e-494a-854d-7e0969cc1197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.831440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29ec45-2227-434d-a299-4be889440c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:14.832603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ec45-2227-434d-a299-4be889440c31 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:14.833051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ec45-2227-434d-a299-4be889440c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:14.833523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ec45-2227-434d-a299-4be889440c31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:14.846602 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29ec45-2227-434d-a299-4be889440c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3c29ec45-2227-434d-a299-4be889440c31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:14.855534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:14.856581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:14.857428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:14.858113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:14.859857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 186/365] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:15:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:14.860945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29ec45-2227-434d-a299-4be889440c31 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:14.911697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fdba1-696e-494a-854d-7e0969cc1197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:14.913996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fdba1-696e-494a-854d-7e0969cc1197 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:14.995843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29ec45-2227-434d-a299-4be889440c31 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:15.036012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48986a78-3358-4c77-b14d-e717fa0c4138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:15.036826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48986a78-3358-4c77-b14d-e717fa0c4138 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.037108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48986a78-3358-4c77-b14d-e717fa0c4138 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.037450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48986a78-3358-4c77-b14d-e717fa0c4138 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.043991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 180/366] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:15.045128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fdba1-696e-494a-854d-7e0969cc1197 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.051758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48986a78-3358-4c77-b14d-e717fa0c4138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-48986a78-3358-4c77-b14d-e717fa0c4138 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:15.059892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:15.060810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:15.061618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 187/367] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:15.066996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48986a78-3358-4c77-b14d-e717fa0c4138 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.101082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:15.146613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:15.181372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fdba1-696e-494a-854d-7e0969cc1197 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:15.193009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48986a78-3358-4c77-b14d-e717fa0c4138 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:15.223429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:15.224535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.225140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.225424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.226416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:15.226727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:15.228882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:15.235490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fad44-cd7f-4ca0-ab1c-042fe5e12048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:15.236374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fad44-cd7f-4ca0-ab1c-042fe5e12048 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.236655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fad44-cd7f-4ca0-ab1c-042fe5e12048 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.236928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fad44-cd7f-4ca0-ab1c-042fe5e12048 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.239613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 181/368] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:15.240481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.242023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fad44-cd7f-4ca0-ab1c-042fe5e12048 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:15.248181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fad44-cd7f-4ca0-ab1c-042fe5e12048 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:15.250035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 188/369] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:15.252001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fad44-cd7f-4ca0-ab1c-042fe5e12048 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.368891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92274de-6db9-4d64-923a-cf4ac619d8fb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:15.381627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:15.391541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fad44-cd7f-4ca0-ab1c-042fe5e12048 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:15.400087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:15.410455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:15.411356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.411793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.412141 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.413009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:15.413324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:15.414877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:15.425186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 182/370] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:15.425976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.437553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd28ae-9945-49f6-8405-c1c3551a5f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:15.438499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd28ae-9945-49f6-8405-c1c3551a5f85 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.438795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd28ae-9945-49f6-8405-c1c3551a5f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.439113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd28ae-9945-49f6-8405-c1c3551a5f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.542323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd28ae-9945-49f6-8405-c1c3551a5f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:15.544494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd28ae-9945-49f6-8405-c1c3551a5f85 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:15.550830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29573-4d5f-4665-a2d6-d3318fe242e6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:15.587728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60653e35-32e1-42f9-8487-dcbf4d266af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:15.588668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60653e35-32e1-42f9-8487-dcbf4d266af0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.588954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60653e35-32e1-42f9-8487-dcbf4d266af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.589231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60653e35-32e1-42f9-8487-dcbf4d266af0 None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.590517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60653e35-32e1-42f9-8487-dcbf4d266af0 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:15.592039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60653e35-32e1-42f9-8487-dcbf4d266af0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:15.596166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 183/371] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:15.597103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60653e35-32e1-42f9-8487-dcbf4d266af0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.663743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:15.668930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:15.677418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 189/372] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:15.678334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd28ae-9945-49f6-8405-c1c3551a5f85 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.727442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60653e35-32e1-42f9-8487-dcbf4d266af0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:15.776338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3db984-de4f-494c-b3ab-0f96de60f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:15.777251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3db984-de4f-494c-b3ab-0f96de60f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.777538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3db984-de4f-494c-b3ab-0f96de60f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.778201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3db984-de4f-494c-b3ab-0f96de60f8b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.794710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd28ae-9945-49f6-8405-c1c3551a5f85 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:15.836864 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:15.837568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.837847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.838120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.839002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] RBAC: Adding query filter params (group.id=3f4420ce62f4439d96761c87846cde42, role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=4b468f8138454e05acfac63b45386ffe) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:15.840674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:15.842149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:15.848796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 190/373] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/role_assignments?group.id=3f4420ce62f4439d96761c87846cde42&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:15.849787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.865502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3db984-de4f-494c-b3ab-0f96de60f8b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:15.867725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3db984-de4f-494c-b3ab-0f96de60f8b2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:15.943330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:15.964189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.012958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 184/374] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:16.018821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3db984-de4f-494c-b3ab-0f96de60f8b2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.043651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ddfc3-0f51-4301-ae1b-550542722ed7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.087443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a303bd-d3bc-447a-a774-00aea5531063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.088337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a303bd-d3bc-447a-a774-00aea5531063 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.088612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a303bd-d3bc-447a-a774-00aea5531063 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.088879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a303bd-d3bc-447a-a774-00aea5531063 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.090179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a303bd-d3bc-447a-a774-00aea5531063 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.091784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a303bd-d3bc-447a-a774-00aea5531063 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.093700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 191/375] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:16.101777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a303bd-d3bc-447a-a774-00aea5531063 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.167593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3db984-de4f-494c-b3ab-0f96de60f8b2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.208974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a42e7-3dd1-45b0-a562-49cc6ba2e33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.210473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a42e7-3dd1-45b0-a562-49cc6ba2e33e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.211003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a42e7-3dd1-45b0-a562-49cc6ba2e33e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.211600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a42e7-3dd1-45b0-a562-49cc6ba2e33e None admin] PATH_INFO: `/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.213384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a42e7-3dd1-45b0-a562-49cc6ba2e33e None admin] RBAC: Authorizing `identity:get_project(project_id=c5f14ce4f34142fb8d7bb6b7280eba0a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.215100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a42e7-3dd1-45b0-a562-49cc6ba2e33e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.218351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 185/376] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:16.224937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a42e7-3dd1-45b0-a562-49cc6ba2e33e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.256702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.277370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a303bd-d3bc-447a-a774-00aea5531063 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.326323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.342697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e7217-cff4-47e9-ac92-987134d55c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.343710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e7217-cff4-47e9-ac92-987134d55c85 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.343997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e7217-cff4-47e9-ac92-987134d55c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.344275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e7217-cff4-47e9-ac92-987134d55c85 None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.349120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a42e7-3dd1-45b0-a562-49cc6ba2e33e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.351750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e7217-cff4-47e9-ac92-987134d55c85 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.353483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e7217-cff4-47e9-ac92-987134d55c85 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.355779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 192/377] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:16.376449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e7217-cff4-47e9-ac92-987134d55c85 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.392047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90d6d7-7c76-401c-8785-784d92107236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.392413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90d6d7-7c76-401c-8785-784d92107236 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.392883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90d6d7-7c76-401c-8785-784d92107236 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.393304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90d6d7-7c76-401c-8785-784d92107236 None admin] PATH_INFO: `/v3/groups/2faf9a7e26b84a1c90e775b26fff3c87` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.401386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90d6d7-7c76-401c-8785-784d92107236 None admin] RBAC: Authorizing `identity:get_group(group_id=2faf9a7e26b84a1c90e775b26fff3c87)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.403352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90d6d7-7c76-401c-8785-784d92107236 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.410761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 186/378] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/groups/2faf9a7e26b84a1c90e775b26fff3c87 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:16.412255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90d6d7-7c76-401c-8785-784d92107236 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.521416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90d6d7-7c76-401c-8785-784d92107236 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.531468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.560464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887460a9-ca80-4bb5-b567-747038be6d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.561429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887460a9-ca80-4bb5-b567-747038be6d1b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.561858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887460a9-ca80-4bb5-b567-747038be6d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.562276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887460a9-ca80-4bb5-b567-747038be6d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.563725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887460a9-ca80-4bb5-b567-747038be6d1b None admin] RBAC: Adding query filter params (group.id=2faf9a7e26b84a1c90e775b26fff3c87, role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c5f14ce4f34142fb8d7bb6b7280eba0a) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:16.564194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887460a9-ca80-4bb5-b567-747038be6d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.565789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887460a9-ca80-4bb5-b567-747038be6d1b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.575074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 187/379] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/role_assignments?group.id=2faf9a7e26b84a1c90e775b26fff3c87&scope.project.id=c5f14ce4f34142fb8d7bb6b7280eba0a&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:16.576902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0d3e-66d7-4843-9264-c9462c4ff14f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.577341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0d3e-66d7-4843-9264-c9462c4ff14f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.578245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa0d3e-66d7-4843-9264-c9462c4ff14f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.584331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 188/380] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:16.592734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e160c-5293-4870-b4d0-22d461d65532 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.593035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e160c-5293-4870-b4d0-22d461d65532 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.593290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e160c-5293-4870-b4d0-22d461d65532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.615780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e7217-cff4-47e9-ac92-987134d55c85 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.628203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-482e160c-5293-4870-b4d0-22d461d65532 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:16.629858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-482e160c-5293-4870-b4d0-22d461d65532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:16.656251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.656935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.657217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.657492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.658346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] RBAC: Adding query filter params (group.id=3f4420ce62f4439d96761c87846cde42, role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=4b468f8138454e05acfac63b45386ffe) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:16.658657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.660185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.673249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 193/381] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/role_assignments?group.id=3f4420ce62f4439d96761c87846cde42&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=ad532b5de50547a7a0f952954be2d53e => generated 260 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:16.734368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 189/382] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:16.769699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.854408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.907685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758885cb-44f3-4861-8fa3-674a46b9618a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.957803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3e0ae-9812-4fe8-9178-bdfe332242b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.958649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e0ae-9812-4fe8-9178-bdfe332242b2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.958935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e0ae-9812-4fe8-9178-bdfe332242b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.959351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e0ae-9812-4fe8-9178-bdfe332242b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.975364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3e0ae-9812-4fe8-9178-bdfe332242b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-51d3e0ae-9812-4fe8-9178-bdfe332242b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:16.983637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:16.984556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:16.985831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 194/383] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:16.991269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e160c-5293-4870-b4d0-22d461d65532 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.100131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:17.120280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e160c-5293-4870-b4d0-22d461d65532 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.168615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858de89-29bf-45a7-a917-afb7046f1cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.169402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858de89-29bf-45a7-a917-afb7046f1cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.169589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858de89-29bf-45a7-a917-afb7046f1cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.169867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858de89-29bf-45a7-a917-afb7046f1cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.170628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858de89-29bf-45a7-a917-afb7046f1cf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:17.170941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858de89-29bf-45a7-a917-afb7046f1cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.172370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858de89-29bf-45a7-a917-afb7046f1cf1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.182448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 190/384] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:17.187857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3e0ae-9812-4fe8-9178-bdfe332242b2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.251807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71991-a894-4189-b27c-4d5769cfd2f4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.252129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71991-a894-4189-b27c-4d5769cfd2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.252370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71991-a894-4189-b27c-4d5769cfd2f4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.253757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 191/385] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:17.260226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ffa4-8913-4531-8a3e-4cbc45a70a67 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.260513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ffa4-8913-4531-8a3e-4cbc45a70a67 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.260788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ffa4-8913-4531-8a3e-4cbc45a70a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.288675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-89f9ffa4-8913-4531-8a3e-4cbc45a70a67 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:17.289887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-89f9ffa4-8913-4531-8a3e-4cbc45a70a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:17.366364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3e0ae-9812-4fe8-9178-bdfe332242b2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.407457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:17.434648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 192/386] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:17.436444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d358bf-2a4b-476b-a3de-fa58404a6158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.437336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d358bf-2a4b-476b-a3de-fa58404a6158 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.437620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d358bf-2a4b-476b-a3de-fa58404a6158 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.437898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d358bf-2a4b-476b-a3de-fa58404a6158 None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.439136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d358bf-2a4b-476b-a3de-fa58404a6158 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.440629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d358bf-2a4b-476b-a3de-fa58404a6158 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.442733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 195/387] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:17 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:17.452041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9ffa4-8913-4531-8a3e-4cbc45a70a67 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.465997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d358bf-2a4b-476b-a3de-fa58404a6158 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.564307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:17.593215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9ffa4-8913-4531-8a3e-4cbc45a70a67 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.640500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02333d-1c9e-466a-8373-93567472290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.642203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02333d-1c9e-466a-8373-93567472290a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.642489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02333d-1c9e-466a-8373-93567472290a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.642765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02333d-1c9e-466a-8373-93567472290a None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.644164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02333d-1c9e-466a-8373-93567472290a None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.645648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02333d-1c9e-466a-8373-93567472290a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.652730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 193/388] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:17 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:17.656134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02333d-1c9e-466a-8373-93567472290a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.677316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d358bf-2a4b-476b-a3de-fa58404a6158 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.741979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64affb17-350a-4cd8-88b8-182e17b81b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.742796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64affb17-350a-4cd8-88b8-182e17b81b5b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.743114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64affb17-350a-4cd8-88b8-182e17b81b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.743389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64affb17-350a-4cd8-88b8-182e17b81b5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.767343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64affb17-350a-4cd8-88b8-182e17b81b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-64affb17-350a-4cd8-88b8-182e17b81b5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:17.778421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:17.779391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:17.780347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 196/389] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:17.793243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64affb17-350a-4cd8-88b8-182e17b81b5b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.858587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02333d-1c9e-466a-8373-93567472290a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.873308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:17.908305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238fa9c-22d8-4a5f-b33b-08e2bb1cb122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.909348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238fa9c-22d8-4a5f-b33b-08e2bb1cb122 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.909646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238fa9c-22d8-4a5f-b33b-08e2bb1cb122 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.910039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238fa9c-22d8-4a5f-b33b-08e2bb1cb122 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3/groups/3f4420ce62f4439d96761c87846cde42/roles/ad532b5de50547a7a0f952954be2d53e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.914119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238fa9c-22d8-4a5f-b33b-08e2bb1cb122 None admin] RBAC: Authorizing `identity:create_grant(project_id=d841afc24eab4adcbe2c3086e54770c3, group_id=3f4420ce62f4439d96761c87846cde42, role_id=ad532b5de50547a7a0f952954be2d53e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.915627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238fa9c-22d8-4a5f-b33b-08e2bb1cb122 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.932402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 194/390] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jul 20 15:15:17 2022] PUT /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3/groups/3f4420ce62f4439d96761c87846cde42/roles/ad532b5de50547a7a0f952954be2d53e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:15:17.963842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64affb17-350a-4cd8-88b8-182e17b81b5b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:18.018773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:18.020041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:18.022046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:18.022046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:18.022046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:18.022461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:18.026616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:18.041227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 197/391] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:18.046949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238fa9c-22d8-4a5f-b33b-08e2bb1cb122 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:18.051302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:18.193183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238fa9c-22d8-4a5f-b33b-08e2bb1cb122 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:18.234939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ed994-773c-42f3-98c8-70a97e0310bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:18.235953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ed994-773c-42f3-98c8-70a97e0310bc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:18.236240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ed994-773c-42f3-98c8-70a97e0310bc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:18.236522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ed994-773c-42f3-98c8-70a97e0310bc None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:18.243349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ed994-773c-42f3-98c8-70a97e0310bc None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:18.243349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ed994-773c-42f3-98c8-70a97e0310bc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:18.244151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 195/392] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:18 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:18.249448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:18.360077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a750b-1bb3-468c-90be-2ecb6893e2dd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:18.370904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:18.401280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fbd91-0e7d-4f5a-b3d5-309696a80b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:18.402603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fbd91-0e7d-4f5a-b3d5-309696a80b83 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:18.403117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fbd91-0e7d-4f5a-b3d5-309696a80b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:18.403591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fbd91-0e7d-4f5a-b3d5-309696a80b83 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:18.405067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fbd91-0e7d-4f5a-b3d5-309696a80b83 None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:18.406770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fbd91-0e7d-4f5a-b3d5-309696a80b83 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:18.409034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 198/393] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:18 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:18.414423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ed994-773c-42f3-98c8-70a97e0310bc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:18.488455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:18.521715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ed994-773c-42f3-98c8-70a97e0310bc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:18.556958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45c2b7-15f6-457b-8007-4ca6becd1392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:18.557922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c2b7-15f6-457b-8007-4ca6becd1392 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:18.558206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c2b7-15f6-457b-8007-4ca6becd1392 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:18.558479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c2b7-15f6-457b-8007-4ca6becd1392 None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3/groups/3f4420ce62f4439d96761c87846cde42/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:18.560509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45c2b7-15f6-457b-8007-4ca6becd1392 None admin] RBAC: Authorizing `identity:create_grant(project_id=d841afc24eab4adcbe2c3086e54770c3, group_id=3f4420ce62f4439d96761c87846cde42, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:18.561993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45c2b7-15f6-457b-8007-4ca6becd1392 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:18.578389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 196/394] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jul 20 15:15:18 2022] PUT /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3/groups/3f4420ce62f4439d96761c87846cde42/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:18.829620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee730d6-59da-41bc-9d74-48d5647b9237 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:18.829811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee730d6-59da-41bc-9d74-48d5647b9237 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:18.830094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee730d6-59da-41bc-9d74-48d5647b9237 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:18.831895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 199/395] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:18.837754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc3cf1-7814-4034-b90c-9393f789c297 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:18.838304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc3cf1-7814-4034-b90c-9393f789c297 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:18.838775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc3cf1-7814-4034-b90c-9393f789c297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:18.868173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-43bc3cf1-7814-4034-b90c-9393f789c297 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:18.870120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-43bc3cf1-7814-4034-b90c-9393f789c297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:18.964669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 197/396] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:18.990656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee730d6-59da-41bc-9d74-48d5647b9237 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:19.051009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afbd4-d8f2-46e1-baf4-e32f4d8ae056 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.051333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afbd4-d8f2-46e1-baf4-e32f4d8ae056 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.051559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afbd4-d8f2-46e1-baf4-e32f4d8ae056 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.053510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 198/397] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:19.059108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890130d-bc8d-4e17-91d9-b71251270eb7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.059414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890130d-bc8d-4e17-91d9-b71251270eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.059664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890130d-bc8d-4e17-91d9-b71251270eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.100171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0890130d-bc8d-4e17-91d9-b71251270eb7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:19.101308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0890130d-bc8d-4e17-91d9-b71251270eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:19.137318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee730d6-59da-41bc-9d74-48d5647b9237 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:19.204124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa2de-f8ff-4be4-b6b9-bcc80edd8816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:19.206064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa2de-f8ff-4be4-b6b9-bcc80edd8816 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.207873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa2de-f8ff-4be4-b6b9-bcc80edd8816 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.208392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa2de-f8ff-4be4-b6b9-bcc80edd8816 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.221258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:19.231561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa2de-f8ff-4be4-b6b9-bcc80edd8816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:19.246415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 199/398] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-926aa2de-f8ff-4be4-b6b9-bcc80edd8816 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:19.247175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:19.248095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:19.248869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:19.251569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 200/399] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:19.257016 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890130d-bc8d-4e17-91d9-b71251270eb7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:19.291699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa2de-f8ff-4be4-b6b9-bcc80edd8816 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:19.337440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:19.406885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa2de-f8ff-4be4-b6b9-bcc80edd8816 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:19.455409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890130d-bc8d-4e17-91d9-b71251270eb7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:19.460565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa914ca1-6c42-440b-ad6f-56bb320f4dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:19.462453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa914ca1-6c42-440b-ad6f-56bb320f4dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.462743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa914ca1-6c42-440b-ad6f-56bb320f4dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.463061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa914ca1-6c42-440b-ad6f-56bb320f4dc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.475613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa914ca1-6c42-440b-ad6f-56bb320f4dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-aa914ca1-6c42-440b-ad6f-56bb320f4dc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:19.487667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:19.488599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:19.489379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:19.489985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 201/400] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:15:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:19.491056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98634-9a14-4a46-80cb-24ee1cd62be7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.491745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98634-9a14-4a46-80cb-24ee1cd62be7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.491745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98634-9a14-4a46-80cb-24ee1cd62be7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.493043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 202/401] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:19.495990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d98634-9a14-4a46-80cb-24ee1cd62be7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:19.500314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658f671-4cc9-4065-a267-94a25d6db5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:19.500994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f671-4cc9-4065-a267-94a25d6db5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.501273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f671-4cc9-4065-a267-94a25d6db5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.501612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658f671-4cc9-4065-a267-94a25d6db5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.505252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658f671-4cc9-4065-a267-94a25d6db5b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:19.505614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658f671-4cc9-4065-a267-94a25d6db5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:19.507160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658f671-4cc9-4065-a267-94a25d6db5b2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:19.518948 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 200/402] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:19.520620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133fb0d-e53c-4cae-a16d-dc739b0a4949 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.520797 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133fb0d-e53c-4cae-a16d-dc739b0a4949 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.522790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133fb0d-e53c-4cae-a16d-dc739b0a4949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.545712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2133fb0d-e53c-4cae-a16d-dc739b0a4949 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:19.547629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2133fb0d-e53c-4cae-a16d-dc739b0a4949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:19.610471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:19.634165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d98634-9a14-4a46-80cb-24ee1cd62be7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:19.637859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:19.638452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 201/403] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:19.639376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133fb0d-e53c-4cae-a16d-dc739b0a4949 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:19.696947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:19.699538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.699968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.700421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.701436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:19.701890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:19.703550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:19.713385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 203/404] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:19.714512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:19.789822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133fb0d-e53c-4cae-a16d-dc739b0a4949 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:19.835400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42f00e-d61d-4018-a51b-462df1916e04 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:19.839903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044337d-f39b-4719-9cdc-f6f3d2e27f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:19.841004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044337d-f39b-4719-9cdc-f6f3d2e27f9f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.841538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044337d-f39b-4719-9cdc-f6f3d2e27f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.841953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044337d-f39b-4719-9cdc-f6f3d2e27f9f None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.843392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044337d-f39b-4719-9cdc-f6f3d2e27f9f None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:19.845269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044337d-f39b-4719-9cdc-f6f3d2e27f9f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:19.847483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 202/405] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:19 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:19.848448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044337d-f39b-4719-9cdc-f6f3d2e27f9f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:19.880355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ecf47-fadf-471d-8cdd-22c130cfaf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:19.881338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ecf47-fadf-471d-8cdd-22c130cfaf14 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.881616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ecf47-fadf-471d-8cdd-22c130cfaf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.881894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ecf47-fadf-471d-8cdd-22c130cfaf14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.895051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ecf47-fadf-471d-8cdd-22c130cfaf14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-9e0ecf47-fadf-471d-8cdd-22c130cfaf14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:19.904353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:19.905427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:19.906312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 204/406] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:19.907008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ecf47-fadf-471d-8cdd-22c130cfaf14 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:19.914345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:19.934334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:19.981689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044337d-f39b-4719-9cdc-f6f3d2e27f9f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.020896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff5c4c-1ac0-4ed6-a128-a58ccb20a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.021937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff5c4c-1ac0-4ed6-a128-a58ccb20a49c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.022213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff5c4c-1ac0-4ed6-a128-a58ccb20a49c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.022478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff5c4c-1ac0-4ed6-a128-a58ccb20a49c None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.023675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff5c4c-1ac0-4ed6-a128-a58ccb20a49c None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.025123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff5c4c-1ac0-4ed6-a128-a58ccb20a49c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.026624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ecf47-fadf-471d-8cdd-22c130cfaf14 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.027068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 203/407] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:19 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:20.027897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff5c4c-1ac0-4ed6-a128-a58ccb20a49c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.063811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2387ec-be73-4431-8fe6-170484b73e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.065049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2387ec-be73-4431-8fe6-170484b73e22 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.065530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2387ec-be73-4431-8fe6-170484b73e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.066039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2387ec-be73-4431-8fe6-170484b73e22 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.067469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2387ec-be73-4431-8fe6-170484b73e22 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.069300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2387ec-be73-4431-8fe6-170484b73e22 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.071793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 205/408] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:19 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:20.072846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2387ec-be73-4431-8fe6-170484b73e22 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.140429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff5c4c-1ac0-4ed6-a128-a58ccb20a49c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.163424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.173872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.189832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.190734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.191210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.191346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2387ec-be73-4431-8fe6-170484b73e22 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.191740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.192922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:20.193404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.195951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.207775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 204/409] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:20.209346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.229290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e04ee-92d5-4e51-8014-827f831e06f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.230291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e04ee-92d5-4e51-8014-827f831e06f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.230538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e04ee-92d5-4e51-8014-827f831e06f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.230818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e04ee-92d5-4e51-8014-827f831e06f5 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.232197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e04ee-92d5-4e51-8014-827f831e06f5 None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.233611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e04ee-92d5-4e51-8014-827f831e06f5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.240553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 206/410] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:20.241488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e04ee-92d5-4e51-8014-827f831e06f5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.338270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cc07-8ead-485f-b2f5-e97435b1ec41 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.361705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e04ee-92d5-4e51-8014-827f831e06f5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.383047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50087367-3e38-47bc-90b4-5817873f3253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.384639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087367-3e38-47bc-90b4-5817873f3253 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.385062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087367-3e38-47bc-90b4-5817873f3253 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.385760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50087367-3e38-47bc-90b4-5817873f3253 None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe/groups/3f4420ce62f4439d96761c87846cde42/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.388918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50087367-3e38-47bc-90b4-5817873f3253 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b468f8138454e05acfac63b45386ffe, group_id=3f4420ce62f4439d96761c87846cde42, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.391201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50087367-3e38-47bc-90b4-5817873f3253 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.400341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976265de-75d5-4b57-8140-01707371db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.401315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976265de-75d5-4b57-8140-01707371db71 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.401597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976265de-75d5-4b57-8140-01707371db71 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.401871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976265de-75d5-4b57-8140-01707371db71 None admin] PATH_INFO: `/v3/groups/2faf9a7e26b84a1c90e775b26fff3c87` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.403201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976265de-75d5-4b57-8140-01707371db71 None admin] RBAC: Authorizing `identity:get_group(group_id=2faf9a7e26b84a1c90e775b26fff3c87)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.404982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976265de-75d5-4b57-8140-01707371db71 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.406664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 207/411] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/groups/2faf9a7e26b84a1c90e775b26fff3c87 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:20.407554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976265de-75d5-4b57-8140-01707371db71 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.420097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 205/412] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jul 20 15:15:20 2022] PUT /identity/v3/projects/4b468f8138454e05acfac63b45386ffe/groups/3f4420ce62f4439d96761c87846cde42/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:20.420097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50087367-3e38-47bc-90b4-5817873f3253 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.464689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.510226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.614841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50087367-3e38-47bc-90b4-5817873f3253 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.615061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976265de-75d5-4b57-8140-01707371db71 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.662823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e566f4-d1d3-4513-b782-2fa0e556b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.663787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a3043-6f6c-42c9-8ff4-adb242f7bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.663936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e566f4-d1d3-4513-b782-2fa0e556b76b None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.664206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e566f4-d1d3-4513-b782-2fa0e556b76b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.664483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e566f4-d1d3-4513-b782-2fa0e556b76b None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe/groups/3f4420ce62f4439d96761c87846cde42/roles/ad532b5de50547a7a0f952954be2d53e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.665577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a3043-6f6c-42c9-8ff4-adb242f7bed1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.666139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a3043-6f6c-42c9-8ff4-adb242f7bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.666610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a3043-6f6c-42c9-8ff4-adb242f7bed1 None admin] PATH_INFO: `/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.666719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e566f4-d1d3-4513-b782-2fa0e556b76b None admin] RBAC: Authorizing `identity:create_grant(project_id=4b468f8138454e05acfac63b45386ffe, group_id=3f4420ce62f4439d96761c87846cde42, role_id=ad532b5de50547a7a0f952954be2d53e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.668108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a3043-6f6c-42c9-8ff4-adb242f7bed1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5f14ce4f34142fb8d7bb6b7280eba0a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.668210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e566f4-d1d3-4513-b782-2fa0e556b76b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.669972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a3043-6f6c-42c9-8ff4-adb242f7bed1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.672767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 206/413] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a => generated 344 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:20.674310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e7c4e-2c6a-4aeb-a6ed-6d4debe07ec0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.674783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e7c4e-2c6a-4aeb-a6ed-6d4debe07ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.675233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e7c4e-2c6a-4aeb-a6ed-6d4debe07ec0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.676670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 207/414] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:20.683180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd6bdb-2199-4cde-8bd6-78ec4b65628d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.683741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd6bdb-2199-4cde-8bd6-78ec4b65628d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.684691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd6bdb-2199-4cde-8bd6-78ec4b65628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.688169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 208/415] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jul 20 15:15:20 2022] PUT /identity/v3/projects/4b468f8138454e05acfac63b45386ffe/groups/3f4420ce62f4439d96761c87846cde42/roles/ad532b5de50547a7a0f952954be2d53e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:20.689025 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e566f4-d1d3-4513-b782-2fa0e556b76b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.718888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3acd6bdb-2199-4cde-8bd6-78ec4b65628d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:20.723647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3acd6bdb-2199-4cde-8bd6-78ec4b65628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:20.868327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.883135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 208/416] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:20.893250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e566f4-d1d3-4513-b782-2fa0e556b76b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.906452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd6bdb-2199-4cde-8bd6-78ec4b65628d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.938008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7264f5a-178c-4fe6-9f16-6f47ba55e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.939454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264f5a-178c-4fe6-9f16-6f47ba55e4e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.940109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264f5a-178c-4fe6-9f16-6f47ba55e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.940522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264f5a-178c-4fe6-9f16-6f47ba55e4e6 None admin] PATH_INFO: `/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a/groups/2faf9a7e26b84a1c90e775b26fff3c87/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.948542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7264f5a-178c-4fe6-9f16-6f47ba55e4e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f14ce4f34142fb8d7bb6b7280eba0a, group_id=2faf9a7e26b84a1c90e775b26fff3c87, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.951176 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7264f5a-178c-4fe6-9f16-6f47ba55e4e6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.966273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.979059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 209/417] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jul 20 15:15:20 2022] PUT /identity/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a/groups/2faf9a7e26b84a1c90e775b26fff3c87/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:21.063631 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd6bdb-2199-4cde-8bd6-78ec4b65628d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.114652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0913f-30f3-4fb4-a44b-c36d8286fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.115899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0913f-30f3-4fb4-a44b-c36d8286fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.116335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0913f-30f3-4fb4-a44b-c36d8286fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.116748 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0913f-30f3-4fb4-a44b-c36d8286fcc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.122114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0632f-fc63-493a-8911-b48e427ebbd1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.122327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0632f-fc63-493a-8911-b48e427ebbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.122612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0632f-fc63-493a-8911-b48e427ebbd1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.125469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 210/418] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:15:21.129984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f552-ced0-4375-9a26-7026c3bbd180 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.130160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0913f-30f3-4fb4-a44b-c36d8286fcc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:21.130257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f552-ced0-4375-9a26-7026c3bbd180 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.130545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f552-ced0-4375-9a26-7026c3bbd180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-98b0913f-30f3-4fb4-a44b-c36d8286fcc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:21.140803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:21.141805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:21.142581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:21.145902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 209/419] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:21.150755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-81c0f552-ced0-4375-9a26-7026c3bbd180 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:21.151657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0913f-30f3-4fb4-a44b-c36d8286fcc6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.152006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-81c0f552-ced0-4375-9a26-7026c3bbd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:21.243712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 211/420] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:21.274266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0f552-ced0-4375-9a26-7026c3bbd180 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.303224 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0913f-30f3-4fb4-a44b-c36d8286fcc6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.307279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.381117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.381750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.382123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.382466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.383342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:21.383711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:21.385199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:21.394504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 210/421] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:21.400371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.407386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.473876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0f552-ced0-4375-9a26-7026c3bbd180 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.545151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cee5a-4047-494f-9baf-f6c7aee30d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.546558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cee5a-4047-494f-9baf-f6c7aee30d31 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.546833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cee5a-4047-494f-9baf-f6c7aee30d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.547129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cee5a-4047-494f-9baf-f6c7aee30d31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.549783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdbbdf-f858-465e-add5-ae1f04d8328e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.571867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cee5a-4047-494f-9baf-f6c7aee30d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e76cee5a-4047-494f-9baf-f6c7aee30d31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:21.585573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:21.586498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:21.587319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:21.590412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 212/422] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:21.594062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cee5a-4047-494f-9baf-f6c7aee30d31 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.614786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5c18d-3032-46c6-8026-436ba68c662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.615851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5c18d-3032-46c6-8026-436ba68c662a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.618517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5c18d-3032-46c6-8026-436ba68c662a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.618815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5c18d-3032-46c6-8026-436ba68c662a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.703317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.721684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cee5a-4047-494f-9baf-f6c7aee30d31 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.773244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.782456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.783161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.783442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.783726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.784478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:21.784784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:21.786207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:21.797394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5c18d-3032-46c6-8026-436ba68c662a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:21.798944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5c18d-3032-46c6-8026-436ba68c662a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:21.808099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 213/423] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:21.816805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.983434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77740e-33c2-4caf-b2a3-c91fe334cc6e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.008497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 211/424] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:15:22.014040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5c18d-3032-46c6-8026-436ba68c662a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:22.019729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44df14-7d5c-4e0c-863d-53c927f2d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.021354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44df14-7d5c-4e0c-863d-53c927f2d3dc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.021658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44df14-7d5c-4e0c-863d-53c927f2d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.021936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44df14-7d5c-4e0c-863d-53c927f2d3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.090200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:22.098281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44df14-7d5c-4e0c-863d-53c927f2d3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.099924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44df14-7d5c-4e0c-863d-53c927f2d3dc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:22.179993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:22.203743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 214/425] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:15:22.211950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44df14-7d5c-4e0c-863d-53c927f2d3dc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:22.285167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5c18d-3032-46c6-8026-436ba68c662a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.340196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239daf9-18cc-4e0e-af25-f1dc4db3aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.341329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239daf9-18cc-4e0e-af25-f1dc4db3aadd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.341925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239daf9-18cc-4e0e-af25-f1dc4db3aadd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.343862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239daf9-18cc-4e0e-af25-f1dc4db3aadd None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.346127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239daf9-18cc-4e0e-af25-f1dc4db3aadd None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.348517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239daf9-18cc-4e0e-af25-f1dc4db3aadd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:22.350616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 212/426] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:22 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:22.358233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239daf9-18cc-4e0e-af25-f1dc4db3aadd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:22.368981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:22.374867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44df14-7d5c-4e0c-863d-53c927f2d3dc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.428819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800e7d2-2002-45a9-923d-7a9b0036510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.435069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800e7d2-2002-45a9-923d-7a9b0036510b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.435505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800e7d2-2002-45a9-923d-7a9b0036510b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.435917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800e7d2-2002-45a9-923d-7a9b0036510b None admin] PATH_INFO: `/v3/projects/d841afc24eab4adcbe2c3086e54770c3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.437347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800e7d2-2002-45a9-923d-7a9b0036510b None admin] RBAC: Authorizing `identity:get_project(project_id=d841afc24eab4adcbe2c3086e54770c3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.438994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800e7d2-2002-45a9-923d-7a9b0036510b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:22.448175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 215/427] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:22 2022] GET /identity/v3/projects/d841afc24eab4adcbe2c3086e54770c3 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:22.450951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800e7d2-2002-45a9-923d-7a9b0036510b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:22.552557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239daf9-18cc-4e0e-af25-f1dc4db3aadd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.588523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:22.597886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2176ef-ccea-4df4-b855-95bad22f7068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.600139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2176ef-ccea-4df4-b855-95bad22f7068 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.600788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2176ef-ccea-4df4-b855-95bad22f7068 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.601684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2176ef-ccea-4df4-b855-95bad22f7068 None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.604081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2176ef-ccea-4df4-b855-95bad22f7068 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.606953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2176ef-ccea-4df4-b855-95bad22f7068 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:22.609222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 213/428] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:22 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:22.614577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2176ef-ccea-4df4-b855-95bad22f7068 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:22.649183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800e7d2-2002-45a9-923d-7a9b0036510b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.713890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5154ed-d1b5-494c-801b-3e4186207f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.715684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5154ed-d1b5-494c-801b-3e4186207f48 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.716261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5154ed-d1b5-494c-801b-3e4186207f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.717725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5154ed-d1b5-494c-801b-3e4186207f48 None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.719807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5154ed-d1b5-494c-801b-3e4186207f48 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.721302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5154ed-d1b5-494c-801b-3e4186207f48 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:22.723152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 216/429] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:22 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:22.730258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5154ed-d1b5-494c-801b-3e4186207f48 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:22.789453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:22.794825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2176ef-ccea-4df4-b855-95bad22f7068 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.838156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a27b86-ce03-4be0-a258-be2ba7985b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.839206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27b86-ce03-4be0-a258-be2ba7985b6f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.839685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27b86-ce03-4be0-a258-be2ba7985b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.840153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27b86-ce03-4be0-a258-be2ba7985b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.841701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a27b86-ce03-4be0-a258-be2ba7985b6f None admin] RBAC: Adding query filter params (group.id=3f4420ce62f4439d96761c87846cde42, role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=d841afc24eab4adcbe2c3086e54770c3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:22.842214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a27b86-ce03-4be0-a258-be2ba7985b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.844329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a27b86-ce03-4be0-a258-be2ba7985b6f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:22.852931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 214/430] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:22 2022] GET /identity/v3/role_assignments?group.id=3f4420ce62f4439d96761c87846cde42&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=ad532b5de50547a7a0f952954be2d53e => generated 611 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:22.854510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693844-8e1f-4977-97e3-415d71568a27 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.855038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693844-8e1f-4977-97e3-415d71568a27 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.855510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693844-8e1f-4977-97e3-415d71568a27 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.857049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 215/431] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:22.865669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cead2f-02c8-4fa8-a647-6fe9adb3058b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.866325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cead2f-02c8-4fa8-a647-6fe9adb3058b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.866799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cead2f-02c8-4fa8-a647-6fe9adb3058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.887155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-89cead2f-02c8-4fa8-a647-6fe9adb3058b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:22.889111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-89cead2f-02c8-4fa8-a647-6fe9adb3058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:22.897408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5154ed-d1b5-494c-801b-3e4186207f48 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.986530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac89748-dabf-434a-8490-514906bfdda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.987625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89748-dabf-434a-8490-514906bfdda0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.989152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89748-dabf-434a-8490-514906bfdda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.991316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac89748-dabf-434a-8490-514906bfdda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.992450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac89748-dabf-434a-8490-514906bfdda0 None admin] RBAC: Adding query filter params (group.id=3f4420ce62f4439d96761c87846cde42, role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=d841afc24eab4adcbe2c3086e54770c3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:22.992984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac89748-dabf-434a-8490-514906bfdda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.995237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac89748-dabf-434a-8490-514906bfdda0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:23.010011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 217/432] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:22 2022] GET /identity/v3/role_assignments?group.id=3f4420ce62f4439d96761c87846cde42&scope.project.id=d841afc24eab4adcbe2c3086e54770c3&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 611 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:23.010251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:23.023262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 216/433] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:23.048464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cead2f-02c8-4fa8-a647-6fe9adb3058b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:23.048655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1f24e-e3f9-46cb-8707-3c521d7e5e44 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.048869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1f24e-e3f9-46cb-8707-3c521d7e5e44 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.049072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1f24e-e3f9-46cb-8707-3c521d7e5e44 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.050779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 218/434] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:23.068799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53c697-42c9-4b36-b26c-cfbed52cf55c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.069107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53c697-42c9-4b36-b26c-cfbed52cf55c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.069348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53c697-42c9-4b36-b26c-cfbed52cf55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.089301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ac53c697-42c9-4b36-b26c-cfbed52cf55c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:23.090456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ac53c697-42c9-4b36-b26c-cfbed52cf55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:23.173291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 219/435] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:23.190098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cead2f-02c8-4fa8-a647-6fe9adb3058b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:23.199542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53c697-42c9-4b36-b26c-cfbed52cf55c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:23.230098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3a41-e59f-4b35-ae24-ac7b198d0575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:23.231242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3a41-e59f-4b35-ae24-ac7b198d0575 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.231704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3a41-e59f-4b35-ae24-ac7b198d0575 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.231977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3a41-e59f-4b35-ae24-ac7b198d0575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.233808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:23.244059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f3a41-e59f-4b35-ae24-ac7b198d0575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-109f3a41-e59f-4b35-ae24-ac7b198d0575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:23.252680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:23.253578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:23.255514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 217/436] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:23.259646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3a41-e59f-4b35-ae24-ac7b198d0575 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:23.314719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:23.321904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53c697-42c9-4b36-b26c-cfbed52cf55c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:23.362408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3219a9d-9732-48ec-b250-0db2bf5984f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:23.363219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3219a9d-9732-48ec-b250-0db2bf5984f0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.363501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3219a9d-9732-48ec-b250-0db2bf5984f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.363771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3219a9d-9732-48ec-b250-0db2bf5984f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.375532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3219a9d-9732-48ec-b250-0db2bf5984f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:23.376137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3a41-e59f-4b35-ae24-ac7b198d0575 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c3219a9d-9732-48ec-b250-0db2bf5984f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:23.385426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:23.386351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:23.387618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 220/437] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:23.393699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3219a9d-9732-48ec-b250-0db2bf5984f0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:23.425657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc05e5-261a-4efa-8dbf-6fe3090f10c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:23.426351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc05e5-261a-4efa-8dbf-6fe3090f10c0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.426632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc05e5-261a-4efa-8dbf-6fe3090f10c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.426924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc05e5-261a-4efa-8dbf-6fe3090f10c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.427694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc05e5-261a-4efa-8dbf-6fe3090f10c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:23.428178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc05e5-261a-4efa-8dbf-6fe3090f10c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:23.429594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc05e5-261a-4efa-8dbf-6fe3090f10c0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:23.439432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 218/438] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:23.447472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5930-3911-4f11-a543-157ffb48cc21 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.447770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5930-3911-4f11-a543-157ffb48cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.448026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5930-3911-4f11-a543-157ffb48cc21 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.449904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 219/439] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:23.450602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5930-3911-4f11-a543-157ffb48cc21 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:23.495988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:23.515880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3219a9d-9732-48ec-b250-0db2bf5984f0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:23.557136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7200-ee81-40e4-8177-e92f808677b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:23.557814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7200-ee81-40e4-8177-e92f808677b2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.558089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7200-ee81-40e4-8177-e92f808677b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.558357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7200-ee81-40e4-8177-e92f808677b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.559152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7200-ee81-40e4-8177-e92f808677b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:23.559590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7200-ee81-40e4-8177-e92f808677b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:23.561006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7200-ee81-40e4-8177-e92f808677b2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:23.569932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 221/440] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:23.571260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaf2a-4ed1-4405-a952-c3ca63e51429 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.571546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaf2a-4ed1-4405-a952-c3ca63e51429 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.571823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaf2a-4ed1-4405-a952-c3ca63e51429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.574843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5930-3911-4f11-a543-157ffb48cc21 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:23.590402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a0ccaf2a-4ed1-4405-a952-c3ca63e51429 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:23.590778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:23.592106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a0ccaf2a-4ed1-4405-a952-c3ca63e51429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:23.621814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8ee90-a7f8-4e42-8684-1016e87ae0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:23.623034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ee90-a7f8-4e42-8684-1016e87ae0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.623034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ee90-a7f8-4e42-8684-1016e87ae0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.623034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8ee90-a7f8-4e42-8684-1016e87ae0d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.674154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 222/441] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:23.675872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccaf2a-4ed1-4405-a952-c3ca63e51429 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:23.710827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8ee90-a7f8-4e42-8684-1016e87ae0d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:23.712346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8ee90-a7f8-4e42-8684-1016e87ae0d6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:23.755363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:23.779536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccaf2a-4ed1-4405-a952-c3ca63e51429 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:23.811407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 220/442] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:23.812260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8ee90-a7f8-4e42-8684-1016e87ae0d6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:23.818952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d2974-8bcb-4ac1-99c7-7aa6fdfdef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:23.819631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2974-8bcb-4ac1-99c7-7aa6fdfdef27 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.820394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2974-8bcb-4ac1-99c7-7aa6fdfdef27 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.820684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2974-8bcb-4ac1-99c7-7aa6fdfdef27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.825803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:23.890303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2974-8bcb-4ac1-99c7-7aa6fdfdef27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:23.891747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d2974-8bcb-4ac1-99c7-7aa6fdfdef27 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:23.914472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8ee90-a7f8-4e42-8684-1016e87ae0d6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:23.952893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483c25-188a-4ade-91a0-bc618a0a92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:23.953707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483c25-188a-4ade-91a0-bc618a0a92a5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:23.953980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483c25-188a-4ade-91a0-bc618a0a92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:23.954248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483c25-188a-4ade-91a0-bc618a0a92a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:23.964584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87483c25-188a-4ade-91a0-bc618a0a92a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:23.968189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-87483c25-188a-4ade-91a0-bc618a0a92a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:23.972280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:23.973161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:23.973956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 221/443] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:23.974630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483c25-188a-4ade-91a0-bc618a0a92a5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:23.994179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 223/444] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:23.995392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d2974-8bcb-4ac1-99c7-7aa6fdfdef27 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.048784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.079320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483c25-188a-4ade-91a0-bc618a0a92a5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.095879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d2974-8bcb-4ac1-99c7-7aa6fdfdef27 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.113145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9df25-1239-4aaa-b201-2108fbb0c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.114020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9df25-1239-4aaa-b201-2108fbb0c6bf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.114281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9df25-1239-4aaa-b201-2108fbb0c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.114548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9df25-1239-4aaa-b201-2108fbb0c6bf None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.116375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9df25-1239-4aaa-b201-2108fbb0c6bf None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.117386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9df25-1239-4aaa-b201-2108fbb0c6bf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.119108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 222/445] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.120240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9df25-1239-4aaa-b201-2108fbb0c6bf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.131362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.132035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.132314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.132585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.133332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:24.133633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.135037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.143712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 224/446] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.144474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.182637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.222654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9df25-1239-4aaa-b201-2108fbb0c6bf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.240915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4ff6c-ac8c-4f44-aa0a-12ed6f51f014 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.256316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b1f3b-3f89-4af3-8bab-67501bda069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.257193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b1f3b-3f89-4af3-8bab-67501bda069e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.257480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b1f3b-3f89-4af3-8bab-67501bda069e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.257749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b1f3b-3f89-4af3-8bab-67501bda069e None admin] PATH_INFO: `/v3/projects/4b468f8138454e05acfac63b45386ffe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.258974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b1f3b-3f89-4af3-8bab-67501bda069e None admin] RBAC: Authorizing `identity:get_project(project_id=4b468f8138454e05acfac63b45386ffe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.260471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b1f3b-3f89-4af3-8bab-67501bda069e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.262196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 223/447] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/projects/4b468f8138454e05acfac63b45386ffe => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.262945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b1f3b-3f89-4af3-8bab-67501bda069e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.273904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80a93-140f-460a-9bd1-b537b3939581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.274762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80a93-140f-460a-9bd1-b537b3939581 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.275069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80a93-140f-460a-9bd1-b537b3939581 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.275336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80a93-140f-460a-9bd1-b537b3939581 None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.276540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80a93-140f-460a-9bd1-b537b3939581 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.277709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.277950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80a93-140f-460a-9bd1-b537b3939581 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.279605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 225/448] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.284641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80a93-140f-460a-9bd1-b537b3939581 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.364664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b1f3b-3f89-4af3-8bab-67501bda069e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.383898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80a93-140f-460a-9bd1-b537b3939581 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.392095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.402526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92943a4-7883-4545-85b3-d067ad4ce02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.402887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92943a4-7883-4545-85b3-d067ad4ce02e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.403177 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92943a4-7883-4545-85b3-d067ad4ce02e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.403452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92943a4-7883-4545-85b3-d067ad4ce02e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.423393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a04df0-6473-495e-8fa7-705aabde314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.424270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04df0-6473-495e-8fa7-705aabde314a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.424549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04df0-6473-495e-8fa7-705aabde314a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.424823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04df0-6473-495e-8fa7-705aabde314a None admin] PATH_INFO: `/v3/groups/3f4420ce62f4439d96761c87846cde42` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.426093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a04df0-6473-495e-8fa7-705aabde314a None admin] RBAC: Authorizing `identity:get_group(group_id=3f4420ce62f4439d96761c87846cde42)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.427953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a04df0-6473-495e-8fa7-705aabde314a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.429603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 226/449] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/groups/3f4420ce62f4439d96761c87846cde42 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.430723 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a04df0-6473-495e-8fa7-705aabde314a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.475709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92943a4-7883-4545-85b3-d067ad4ce02e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.477226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92943a4-7883-4545-85b3-d067ad4ce02e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.488590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.533750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a04df0-6473-495e-8fa7-705aabde314a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.567720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.568675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.568973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.569254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.570094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] RBAC: Adding query filter params (group.id=3f4420ce62f4439d96761c87846cde42, role.id=cbefb946f31c4d86944cb79fb63e9e8a, scope.project.id=4b468f8138454e05acfac63b45386ffe) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:24.570407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.571908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.577209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 224/450] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:24.577896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 227/451] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/role_assignments?group.id=3f4420ce62f4439d96761c87846cde42&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=cbefb946f31c4d86944cb79fb63e9e8a => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.578075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92943a4-7883-4545-85b3-d067ad4ce02e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.592301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.640085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.698777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92943a4-7883-4545-85b3-d067ad4ce02e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.709851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.720747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6ecd6-02b6-4f25-aadf-24e087598207 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.737778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.739214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.739214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.739214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.740078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] RBAC: Adding query filter params (group.id=3f4420ce62f4439d96761c87846cde42, role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=4b468f8138454e05acfac63b45386ffe) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:24.740393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.741869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.749502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 225/452] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/role_assignments?group.id=3f4420ce62f4439d96761c87846cde42&scope.project.id=4b468f8138454e05acfac63b45386ffe&role.id=ad532b5de50547a7a0f952954be2d53e => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.761238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b1b11-8055-4fce-929f-3bb3213903ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.762140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b1b11-8055-4fce-929f-3bb3213903ca None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.762426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b1b11-8055-4fce-929f-3bb3213903ca None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.762705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b1b11-8055-4fce-929f-3bb3213903ca None admin] PATH_INFO: `/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.764217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b1b11-8055-4fce-929f-3bb3213903ca None admin] RBAC: Authorizing `identity:get_project(project_id=c5f14ce4f34142fb8d7bb6b7280eba0a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.765756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b1b11-8055-4fce-929f-3bb3213903ca None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.767623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 228/453] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/projects/c5f14ce4f34142fb8d7bb6b7280eba0a => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:24.774281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.888291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace2ae-0bfa-48e2-93b8-6e6237b8b628 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.925344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddce5-2c3c-46a3-9afa-77360cfcc379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.926227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddce5-2c3c-46a3-9afa-77360cfcc379 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.926505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddce5-2c3c-46a3-9afa-77360cfcc379 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.926778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddce5-2c3c-46a3-9afa-77360cfcc379 None admin] PATH_INFO: `/v3/groups/2faf9a7e26b84a1c90e775b26fff3c87` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.928047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ddce5-2c3c-46a3-9afa-77360cfcc379 None admin] RBAC: Authorizing `identity:get_group(group_id=2faf9a7e26b84a1c90e775b26fff3c87)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.929529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ddce5-2c3c-46a3-9afa-77360cfcc379 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.931214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 226/454] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/groups/2faf9a7e26b84a1c90e775b26fff3c87 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.937234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b1b11-8055-4fce-929f-3bb3213903ca None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:25.045300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b1b11-8055-4fce-929f-3bb3213903ca None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:25.052236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:25.079761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c615e7-39f9-4363-874c-625dea3b323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:25.080420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c615e7-39f9-4363-874c-625dea3b323b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:25.080704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c615e7-39f9-4363-874c-625dea3b323b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:25.080978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c615e7-39f9-4363-874c-625dea3b323b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:25.081812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c615e7-39f9-4363-874c-625dea3b323b None admin] RBAC: Adding query filter params (group.id=2faf9a7e26b84a1c90e775b26fff3c87, role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c5f14ce4f34142fb8d7bb6b7280eba0a) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:25.082121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c615e7-39f9-4363-874c-625dea3b323b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:25.083615 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c615e7-39f9-4363-874c-625dea3b323b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:25.089741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 229/455] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/role_assignments?group.id=2faf9a7e26b84a1c90e775b26fff3c87&scope.project.id=c5f14ce4f34142fb8d7bb6b7280eba0a&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:27.495399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4ec0-6508-433e-807c-5815d08095a4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.496437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4ec0-6508-433e-807c-5815d08095a4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.497155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4ec0-6508-433e-807c-5815d08095a4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.499014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 227/456] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:27.504966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af296f0-a71a-46d6-aff7-c8b6252d88c1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.505816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af296f0-a71a-46d6-aff7-c8b6252d88c1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.506295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af296f0-a71a-46d6-aff7-c8b6252d88c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.532428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9af296f0-a71a-46d6-aff7-c8b6252d88c1 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:27.533961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9af296f0-a71a-46d6-aff7-c8b6252d88c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:27.599709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755e08-17f6-44e0-b2bb-5cb19819ec37 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.600353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755e08-17f6-44e0-b2bb-5cb19819ec37 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.600865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755e08-17f6-44e0-b2bb-5cb19819ec37 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.602719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 228/457] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:27.608039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c53f-b818-4c8b-8d60-6be98d14fedf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.608586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c53f-b818-4c8b-8d60-6be98d14fedf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.609061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c53f-b818-4c8b-8d60-6be98d14fedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.626727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 230/458] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:27.627563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7034c53f-b818-4c8b-8d60-6be98d14fedf None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:27.628963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7034c53f-b818-4c8b-8d60-6be98d14fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:27.665888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:27.666816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af296f0-a71a-46d6-aff7-c8b6252d88c1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:27.729452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 229/459] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:15:27.763853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034c53f-b818-4c8b-8d60-6be98d14fedf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:27.843326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:27.846882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af296f0-a71a-46d6-aff7-c8b6252d88c1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:27.887304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034c53f-b818-4c8b-8d60-6be98d14fedf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:27.887873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14584c-4cbf-4d67-a522-a1b9411e0041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:27.888746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14584c-4cbf-4d67-a522-a1b9411e0041 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.889091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14584c-4cbf-4d67-a522-a1b9411e0041 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.889527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14584c-4cbf-4d67-a522-a1b9411e0041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.900635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14584c-4cbf-4d67-a522-a1b9411e0041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:27.902329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14584c-4cbf-4d67-a522-a1b9411e0041 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7f14584c-4cbf-4d67-a522-a1b9411e0041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:27.922432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:27.923563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:27.924647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:27.924647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:27.924647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:27.924647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:27.925503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc0615-d6c3-4121-88f8-1fa0ebf4eda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:27.926522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0615-d6c3-4121-88f8-1fa0ebf4eda1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.926992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0615-d6c3-4121-88f8-1fa0ebf4eda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.927438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0615-d6c3-4121-88f8-1fa0ebf4eda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.930363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 231/460] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:27.931919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5297fb-b10c-473b-b01d-8f24b25b8f43 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.932373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5297fb-b10c-473b-b01d-8f24b25b8f43 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.932811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5297fb-b10c-473b-b01d-8f24b25b8f43 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.935062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 232/461] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:27.936135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5297fb-b10c-473b-b01d-8f24b25b8f43 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:27.938385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc0615-d6c3-4121-88f8-1fa0ebf4eda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:27.940053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc0615-d6c3-4121-88f8-1fa0ebf4eda1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b6dc0615-d6c3-4121-88f8-1fa0ebf4eda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:27.959307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:27.960238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:27.961076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:27.961076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:27.961076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:27.961076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:27.963341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 230/462] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:27.964765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081b343-5042-4937-a623-5e5d9c1f1376 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.965247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081b343-5042-4937-a623-5e5d9c1f1376 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.965732 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081b343-5042-4937-a623-5e5d9c1f1376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.982646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3081b343-5042-4937-a623-5e5d9c1f1376 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:27.984195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3081b343-5042-4937-a623-5e5d9c1f1376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:28.001830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:28.053606 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 231/463] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:28.054822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081b343-5042-4937-a623-5e5d9c1f1376 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:28.057059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5297fb-b10c-473b-b01d-8f24b25b8f43 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:28.094383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:28.095086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.095365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.095636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.096420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:28.096761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:28.098421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:28.122866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 233/464] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:28.123991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:28.140805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:28.158503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081b343-5042-4937-a623-5e5d9c1f1376 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:28.193367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:28.194065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.194348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.194675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.195462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:28.195773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:28.197211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:28.210663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 232/465] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:28.211569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:28.227097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:28.238913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f47f8-8215-4519-b3f8-07d17cd4ad03 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:28.284092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:28.285353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.285824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.286284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.298597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:28.300512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:28.319836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:28.320693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:28.321518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:28.321518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:28.321518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:28.321518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:28.323211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f41f-b916-49c8-ba9b-7deb57a607e3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:28.323989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 234/466] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:28.325211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:28.359293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05fb8-3655-42a1-9d99-ee4ba8b36a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:28.360230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05fb8-3655-42a1-9d99-ee4ba8b36a65 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.360685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05fb8-3655-42a1-9d99-ee4ba8b36a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.361099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05fb8-3655-42a1-9d99-ee4ba8b36a65 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.361999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb05fb8-3655-42a1-9d99-ee4ba8b36a65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:28.363665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb05fb8-3655-42a1-9d99-ee4ba8b36a65 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:28.390604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 233/467] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:15:28 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:28.391882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05fb8-3655-42a1-9d99-ee4ba8b36a65 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:28.407186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:28.453747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4528-ba4b-41d7-b256-2cc488078f63 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:28.492523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:28.495751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d261e07-2750-4874-b8f7-9b8f64b5c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:28.497187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261e07-2750-4874-b8f7-9b8f64b5c80f None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.497711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261e07-2750-4874-b8f7-9b8f64b5c80f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.498686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d261e07-2750-4874-b8f7-9b8f64b5c80f None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.499680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d261e07-2750-4874-b8f7-9b8f64b5c80f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:28.501428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d261e07-2750-4874-b8f7-9b8f64b5c80f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:28.531673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 235/468] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:15:28 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:28.534606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9357f-25a9-4baf-afed-964a4f0f05ab None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.535930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9357f-25a9-4baf-afed-964a4f0f05ab None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.536701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9357f-25a9-4baf-afed-964a4f0f05ab None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.539362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 236/469] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:28.543068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05fb8-3655-42a1-9d99-ee4ba8b36a65 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:28.549288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e517635-0535-4c7e-abb5-fa2c164f7c84 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.549967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e517635-0535-4c7e-abb5-fa2c164f7c84 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.550437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e517635-0535-4c7e-abb5-fa2c164f7c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.578139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6e517635-0535-4c7e-abb5-fa2c164f7c84 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:28.580823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6e517635-0535-4c7e-abb5-fa2c164f7c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:28.603686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:28.604470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.604756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.605031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.605849 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:28.606210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:28.608687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:28.627906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 234/470] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:28.633966 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:28.687108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 237/471] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:28.709081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e517635-0535-4c7e-abb5-fa2c164f7c84 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:28.770701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f85def-f9fd-438d-9be7-e4003d2303ca None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:28.773080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:28.807782 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:28.823062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bee465-3550-405a-a0b6-6ef237a7c3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:28.824066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bee465-3550-405a-a0b6-6ef237a7c3c8 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.824433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bee465-3550-405a-a0b6-6ef237a7c3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.824781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bee465-3550-405a-a0b6-6ef237a7c3c8 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.825554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bee465-3550-405a-a0b6-6ef237a7c3c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:28.827317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bee465-3550-405a-a0b6-6ef237a7c3c8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:28.836956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e517635-0535-4c7e-abb5-fa2c164f7c84 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:28.854788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 235/472] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:15:28 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:15:28.882892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:28.883805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:28.884087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:28.884358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:28.896988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:28.898718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:28.918887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:28.919861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:28.921200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:28.921200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:28.921200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:28.921200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:28.921200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 238/473] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:28.927633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bee465-3550-405a-a0b6-6ef237a7c3c8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.041249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bee465-3550-405a-a0b6-6ef237a7c3c8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:29.075624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e98f00-8d5b-473a-a85b-34dcc1f1a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:29.076306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98f00-8d5b-473a-a85b-34dcc1f1a5db None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.076586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98f00-8d5b-473a-a85b-34dcc1f1a5db None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.076860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98f00-8d5b-473a-a85b-34dcc1f1a5db None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.077588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e98f00-8d5b-473a-a85b-34dcc1f1a5db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:29.077894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e98f00-8d5b-473a-a85b-34dcc1f1a5db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:29.079316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e98f00-8d5b-473a-a85b-34dcc1f1a5db None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:29.092310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 236/474] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:29.097910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.205728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7bac7-7e68-4a71-bad2-8429c9da5f17 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:29.207579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:29.243950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8f405-3746-4fb6-8bc7-d11c3e0975a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:29.245293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8f405-3746-4fb6-8bc7-d11c3e0975a4 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.245760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8f405-3746-4fb6-8bc7-d11c3e0975a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.246229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8f405-3746-4fb6-8bc7-d11c3e0975a4 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.247203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8f405-3746-4fb6-8bc7-d11c3e0975a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:29.248962 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8f405-3746-4fb6-8bc7-d11c3e0975a4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:29.270725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 239/475] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:15:29 2022] POST /identity/v3/users => generated 249 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:15:29.302881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a1cc-e7e9-4299-a565-44e9f3624049 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.303516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a1cc-e7e9-4299-a565-44e9f3624049 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.304024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a1cc-e7e9-4299-a565-44e9f3624049 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.305582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 237/476] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:29.312379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9dab-81c2-4910-b539-b1f42eaf116c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.312689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9dab-81c2-4910-b539-b1f42eaf116c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.312941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9dab-81c2-4910-b539-b1f42eaf116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.333036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-22fd9dab-81c2-4910-b539-b1f42eaf116c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:29.334409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-22fd9dab-81c2-4910-b539-b1f42eaf116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:29.437461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 240/477] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:29.474517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831a1cc-e7e9-4299-a565-44e9f3624049 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.527591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:29.586282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831a1cc-e7e9-4299-a565-44e9f3624049 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:29.622758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:29.623828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.624301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.624875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.625823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:29.627485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:29.635657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.sql.core [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 15:15:29.635657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 15:15:29.635657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [parameters: {'id': '8409d0b925b0404da328cd59417dbd4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 15:15:29.635657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80223) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jul 20 15:15:29.653696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:15:29.654663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application yield resource Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise self.value Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application session.commit() Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 15:15:29.660262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.flush() Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application compat.raise_( Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 15:15:29.661192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:15:29.662046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:15:29.662863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [parameters: {'id': '8409d0b925b0404da328cd59417dbd4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:29.663719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 15:15:29.665993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:29.669951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 238/478] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jul 20 15:15:29 2022] POST /identity/v3/roles => generated 144 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:29.673290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd9dab-81c2-4910-b539-b1f42eaf116c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.774576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:29.791061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd9dab-81c2-4910-b539-b1f42eaf116c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:29.829430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5a6a3-e05d-4482-88b9-1a1bb11665f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:29.830655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a6a3-e05d-4482-88b9-1a1bb11665f3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.831175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a6a3-e05d-4482-88b9-1a1bb11665f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.831655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5a6a3-e05d-4482-88b9-1a1bb11665f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.843057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5a6a3-e05d-4482-88b9-1a1bb11665f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-aed5a6a3-e05d-4482-88b9-1a1bb11665f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:29.851766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:29.852678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:15:29.853449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:29.860296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 241/479] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:15:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:29.862930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.993113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd39d2-e9bb-40a5-9cd3-bee41df27613 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:30.013479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:30.049646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122ba8c-1d3b-41ac-90ce-9a9d94714cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:30.050250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ba8c-1d3b-41ac-90ce-9a9d94714cac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:30.050527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ba8c-1d3b-41ac-90ce-9a9d94714cac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:30.050794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122ba8c-1d3b-41ac-90ce-9a9d94714cac None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:30.051585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122ba8c-1d3b-41ac-90ce-9a9d94714cac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:30.051894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122ba8c-1d3b-41ac-90ce-9a9d94714cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:30.053298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122ba8c-1d3b-41ac-90ce-9a9d94714cac None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:30.062600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 239/480] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:30.934002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab938e-0b08-46a7-868a-a33b8a7c5718 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:30.934627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab938e-0b08-46a7-868a-a33b8a7c5718 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:30.934904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab938e-0b08-46a7-868a-a33b8a7c5718 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:30.937033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 242/481] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:30.942319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e3cd-27c7-451f-b355-c16dffe3033c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:30.942791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e3cd-27c7-451f-b355-c16dffe3033c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:30.942867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e3cd-27c7-451f-b355-c16dffe3033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:30.972214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c055e3cd-27c7-451f-b355-c16dffe3033c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:30.973396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c055e3cd-27c7-451f-b355-c16dffe3033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:31.072425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 240/482] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:31.078812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f036d30-dd3e-47ed-abaf-d48466cfada2 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.079123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f036d30-dd3e-47ed-abaf-d48466cfada2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.079402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f036d30-dd3e-47ed-abaf-d48466cfada2 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.081076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 243/483] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:31.086379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1837d2-2836-4db7-81c9-f3ddbe5ca221 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.086662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1837d2-2836-4db7-81c9-f3ddbe5ca221 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.086937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1837d2-2836-4db7-81c9-f3ddbe5ca221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.111162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3a1837d2-2836-4db7-81c9-f3ddbe5ca221 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:31.112344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3a1837d2-2836-4db7-81c9-f3ddbe5ca221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:31.118322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f036d30-dd3e-47ed-abaf-d48466cfada2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:31.259523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f036d30-dd3e-47ed-abaf-d48466cfada2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:31.260668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 241/484] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:31.316863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1837d2-2836-4db7-81c9-f3ddbe5ca221 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:31.318772 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6047540-a8b2-43f1-b25c-ccb4128dec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:31.319945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047540-a8b2-43f1-b25c-ccb4128dec8d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.320228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047540-a8b2-43f1-b25c-ccb4128dec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.320505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6047540-a8b2-43f1-b25c-ccb4128dec8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.332605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6047540-a8b2-43f1-b25c-ccb4128dec8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e6047540-a8b2-43f1-b25c-ccb4128dec8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:31.343989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:31.344885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:31.345672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 244/485] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:31.352430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6047540-a8b2-43f1-b25c-ccb4128dec8d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:31.375334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:31.377298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:31.462014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1837d2-2836-4db7-81c9-f3ddbe5ca221 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:31.524864 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bc677-3df9-4db1-b687-cfd975682a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:31.525982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bc677-3df9-4db1-b687-cfd975682a30 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.526265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bc677-3df9-4db1-b687-cfd975682a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.526540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bc677-3df9-4db1-b687-cfd975682a30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.538001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bc677-3df9-4db1-b687-cfd975682a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ec2bc677-3df9-4db1-b687-cfd975682a30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:31.546792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:31.547715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:31.548504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 242/486] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:31.558993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bc677-3df9-4db1-b687-cfd975682a30 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:31.579903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6047540-a8b2-43f1-b25c-ccb4128dec8d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:31.615967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2e3cc-c789-44b4-a053-15c03400f16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:31.617339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e3cc-c789-44b4-a053-15c03400f16e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.617826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e3cc-c789-44b4-a053-15c03400f16e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.618415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e3cc-c789-44b4-a053-15c03400f16e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.620040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2e3cc-c789-44b4-a053-15c03400f16e None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:31.620558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2e3cc-c789-44b4-a053-15c03400f16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:31.622581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2e3cc-c789-44b4-a053-15c03400f16e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:31.637260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 245/487] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:31.637260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37dc1-fdaa-4c0d-8128-fbb8b890fe76 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.637260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37dc1-fdaa-4c0d-8128-fbb8b890fe76 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.637260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e37dc1-fdaa-4c0d-8128-fbb8b890fe76 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.644007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 246/488] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:31.644007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e37dc1-fdaa-4c0d-8128-fbb8b890fe76 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:31.676495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:31.689397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bc677-3df9-4db1-b687-cfd975682a30 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:31.720861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:31.732754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c42001-6556-4943-9356-496c8df7272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:31.733810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42001-6556-4943-9356-496c8df7272f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.734311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42001-6556-4943-9356-496c8df7272f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.734847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c42001-6556-4943-9356-496c8df7272f None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.735965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c42001-6556-4943-9356-496c8df7272f None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:31.736460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c42001-6556-4943-9356-496c8df7272f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:31.738175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c42001-6556-4943-9356-496c8df7272f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:31.748349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 243/489] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:31.750016 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074361-62b6-472d-a400-b810f32f74d4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.750493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074361-62b6-472d-a400-b810f32f74d4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.750952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b074361-62b6-472d-a400-b810f32f74d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.760950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e37dc1-fdaa-4c0d-8128-fbb8b890fe76 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:31.769318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8b074361-62b6-472d-a400-b810f32f74d4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:31.770948 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8b074361-62b6-472d-a400-b810f32f74d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:31.796074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:31.796787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.797068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.797334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.808487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:31.809907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:31.827159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:31.828015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:31.828871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:31.828871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:31.828871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:31.828871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:31.833145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 247/490] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:31.833869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:31.855110 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 244/491] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:31.856447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074361-62b6-472d-a400-b810f32f74d4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:31.940232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509639a2-a576-4390-bb97-44ee0ca36d7f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:31.957216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:31.963669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:31.976577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:31.977484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:31.977922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:31.978207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:31.982087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b074361-62b6-472d-a400-b810f32f74d4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:31.989236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:31.990777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:32.008872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:32.009774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:32.010606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:32.010606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:32.010606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:32.010606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:32.014902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 248/492] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:32.015794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.022770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.023809 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.024311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.024769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.025840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:32.026350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.028135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.046688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 245/493] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:32.048756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.124607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e62746-ca80-4636-9213-1cc013c47248 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.160170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28915cad-0c4f-4db3-ad44-a581871593d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.160977 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28915cad-0c4f-4db3-ad44-a581871593d5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.161260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28915cad-0c4f-4db3-ad44-a581871593d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.161536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28915cad-0c4f-4db3-ad44-a581871593d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.164157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e398-0688-46ca-a7b9-d5195c3723ea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.172208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28915cad-0c4f-4db3-ad44-a581871593d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-28915cad-0c4f-4db3-ad44-a581871593d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:32.180319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:32.181229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:32.182031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 249/494] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:32.182676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28915cad-0c4f-4db3-ad44-a581871593d5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.209217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47c565-57fa-48b7-8b23-fb6e39505047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.209942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c565-57fa-48b7-8b23-fb6e39505047 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.210343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c565-57fa-48b7-8b23-fb6e39505047 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.210625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c565-57fa-48b7-8b23-fb6e39505047 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.211468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47c565-57fa-48b7-8b23-fb6e39505047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:32.211768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47c565-57fa-48b7-8b23-fb6e39505047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.213155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47c565-57fa-48b7-8b23-fb6e39505047 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.217253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.231727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 246/495] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:32.231727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908c4c-10fc-4706-9927-6584240e5a5b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.231727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908c4c-10fc-4706-9927-6584240e5a5b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.231727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908c4c-10fc-4706-9927-6584240e5a5b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.231727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 247/496] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:32.231727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61908c4c-10fc-4706-9927-6584240e5a5b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.234801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.293361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28915cad-0c4f-4db3-ad44-a581871593d5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.327367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.328090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.328372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.328648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.336136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.337517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61908c4c-10fc-4706-9927-6584240e5a5b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.337654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:32.353387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:32.354500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 250/497] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:32.355426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.381479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998fd63-ef35-432d-8d58-e97418638683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.382211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fd63-ef35-432d-8d58-e97418638683 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.382495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fd63-ef35-432d-8d58-e97418638683 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.382770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fd63-ef35-432d-8d58-e97418638683 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.383554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998fd63-ef35-432d-8d58-e97418638683 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:32.383859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998fd63-ef35-432d-8d58-e97418638683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.385332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998fd63-ef35-432d-8d58-e97418638683 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.394481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 248/498] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:32.395725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fb8ee-cf24-48a2-8500-20b88df052b5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.396014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fb8ee-cf24-48a2-8500-20b88df052b5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.396289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fb8ee-cf24-48a2-8500-20b88df052b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.413163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1c0fb8ee-cf24-48a2-8500-20b88df052b5 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:32.414465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c0fb8ee-cf24-48a2-8500-20b88df052b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:32.464759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.472245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3f22-e054-44a0-88d9-b062b72282b5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.482087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.499004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 249/499] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:32.499004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fb8ee-cf24-48a2-8500-20b88df052b5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.514190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.515139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.515419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.515690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.523940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.525432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:32.540052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:32.540978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:32.541851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 251/500] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:32.542415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.615803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fb8ee-cf24-48a2-8500-20b88df052b5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.646077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc01818-4fd5-40bc-a2ce-ded8b8ec0b6a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.650163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.650842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.651148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.651417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.652258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:32.652560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.654001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.680553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.681350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.681628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.681896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.689601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 250/501] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:32.690411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.691919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.693409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:32.710882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:32.711838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:32.712910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:32.712910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:32.712910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:32.712910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:32.712910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 252/502] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:32.713217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.722110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.748108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.795827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c55510-a2e0-45d6-ac29-09efde3a36f6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.814032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9f7b6-ef07-4aed-b9d5-a9d7f45e0bcf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.828473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a974a3-a131-490b-8100-5334eb13bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.829275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a974a3-a131-490b-8100-5334eb13bb82 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.829554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a974a3-a131-490b-8100-5334eb13bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.829817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a974a3-a131-490b-8100-5334eb13bb82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.840223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a974a3-a131-490b-8100-5334eb13bb82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:32.846750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.847452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.847734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.848005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-76a974a3-a131-490b-8100-5334eb13bb82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:32.848095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:32.849106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:32.849930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:32.850520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:32.850520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.850644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 251/503] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:32.850736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.850904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722e798-eb73-4977-82bb-b8c58c2bab98 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.851205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722e798-eb73-4977-82bb-b8c58c2bab98 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.851476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722e798-eb73-4977-82bb-b8c58c2bab98 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.852851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 252/504] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:32.855741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722e798-eb73-4977-82bb-b8c58c2bab98 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.889961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 253/505] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:32.891050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.954157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.960512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722e798-eb73-4977-82bb-b8c58c2bab98 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.973660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.992982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d3a42-fd97-4c2a-a6b6-6e429333d44b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.995985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106703b8-01a5-44d3-a74b-9c4d999d1e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.996648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106703b8-01a5-44d3-a74b-9c4d999d1e77 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.996923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106703b8-01a5-44d3-a74b-9c4d999d1e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.997189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106703b8-01a5-44d3-a74b-9c4d999d1e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.033279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.033950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.034218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.034491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.035239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:33.035544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.036950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.048789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 254/506] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:33.049640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.071690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106703b8-01a5-44d3-a74b-9c4d999d1e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.073189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106703b8-01a5-44d3-a74b-9c4d999d1e77 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.145901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac86c1-82af-400c-ba3d-41a05c54d91e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.168882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 253/507] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:33.169185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:33.169987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81ed3-2a57-40f8-a328-60c4ecdc8c34 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.170269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81ed3-2a57-40f8-a328-60c4ecdc8c34 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.170536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81ed3-2a57-40f8-a328-60c4ecdc8c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.181857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.182534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.182816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.183119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.183878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:33.184188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.185625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.186458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-00d81ed3-2a57-40f8-a328-60c4ecdc8c34 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:33.187684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-00d81ed3-2a57-40f8-a328-60c4ecdc8c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:33.194066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 255/508] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:33.194927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.195365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:33.254364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 254/509] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:33.255227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81ed3-2a57-40f8-a328-60c4ecdc8c34 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.309024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ae64-2eb4-48c0-ac98-de92397492a3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.341234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd86d3-ae49-4597-b1b5-59885145798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.341877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd86d3-ae49-4597-b1b5-59885145798f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.342166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd86d3-ae49-4597-b1b5-59885145798f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.342436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd86d3-ae49-4597-b1b5-59885145798f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.351613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81ed3-2a57-40f8-a328-60c4ecdc8c34 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.387380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.388200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.388480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.388764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.396140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.396551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:33.397684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.410363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd86d3-ae49-4597-b1b5-59885145798f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.411887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd86d3-ae49-4597-b1b5-59885145798f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:33.414154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:33.415105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:33.415989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 255/510] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:33.416548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.418928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:33.519430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 256/511] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:33.520410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd86d3-ae49-4597-b1b5-59885145798f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.524810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dd381-1f4b-4d8e-b1bb-3e64a900d749 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.558415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.559248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.559531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.559807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.569769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.571268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:33.588727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:33.589722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:33.590564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:33.590564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:33.590564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:33.590564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:33.590564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 256/512] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:33.590821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.605377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:33.621862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd86d3-ae49-4597-b1b5-59885145798f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.652624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:33.656370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.657181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.657479 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.657730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.667739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.669211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:33.686391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:33.687331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:33.688196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:33.688196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:33.688196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:33.688196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:33.688196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 257/513] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:33.688463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.702175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269248d-5f47-4e78-b85d-190f01f34597 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.736046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.736841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.737116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.737378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.748274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.749783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:33.767247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:33.768123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:33.768960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:33.768960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:33.768960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:33.768960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:33.768960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 257/514] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:33.769210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.792663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6af34-6acf-4741-94f7-510afc9fc64c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.825850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.826524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.826805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.827116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.827965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:33.828276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.829736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.837865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:33.847874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 258/515] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:33.848690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.873614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcce5b-7bf9-4ecd-8a19-0555db3a537c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.880951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:33.908212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.908954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.909236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.909513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.919530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.921009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:33.938802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:33.939788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:33.940668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:33.940668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:33.940668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:33.940668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:33.940668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 258/516] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:33.941308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:33.954478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222cbca-d27c-4355-9929-38c86e1a43f1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:33.988121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:33.988794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:33.989077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:33.989359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:33.990087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:33.990398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:33.991880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.003682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 259/517] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:34.004387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.045912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ec675-305e-459f-b9dd-bf2162db554d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.060042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:34.081112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.081789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.082074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.082359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.083135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:34.083440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.084829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.096014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 259/518] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:34.096803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.108736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950217b-568d-4195-9889-4a1f73ab479c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.115158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:34.146546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.147241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.147579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.147881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.148606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:34.148914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.150324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.162145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 260/519] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:34.162885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.195335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1682e-b108-4432-bdbd-d9a3ed03e345 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.229725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772c00e-aa4b-4873-87df-84f64ebb6375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.230381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772c00e-aa4b-4873-87df-84f64ebb6375 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.230667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772c00e-aa4b-4873-87df-84f64ebb6375 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.230945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772c00e-aa4b-4873-87df-84f64ebb6375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.265088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e371e-660b-4344-a5dd-7cd577b33d78 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.281936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:34.297788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772c00e-aa4b-4873-87df-84f64ebb6375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.299310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772c00e-aa4b-4873-87df-84f64ebb6375 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.300734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.301398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.302397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.302397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.302667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:34.302992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.304439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.315756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 261/520] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:34.316541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.321246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:34.397807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 260/521] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:34.398611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772c00e-aa4b-4873-87df-84f64ebb6375 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.422462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23c01-4fd4-4146-8e42-15a5357885d3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.456857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.457660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.457941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.458248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.465130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.466609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:34.481774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:34.482646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:34.483526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 262/522] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:34.483995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.498861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772c00e-aa4b-4873-87df-84f64ebb6375 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.516229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:34.519954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:34.533685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.534488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.534767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.535069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.542185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.543712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:34.558218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:34.559137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:34.560029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 261/523] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:34.560719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.592473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d757a-4c28-4758-b121-20c8d3935936 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.626469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523ef9d-f844-485d-8a64-82c492260551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.627172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523ef9d-f844-485d-8a64-82c492260551 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.627456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523ef9d-f844-485d-8a64-82c492260551 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.627734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523ef9d-f844-485d-8a64-82c492260551 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.628445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523ef9d-f844-485d-8a64-82c492260551 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.629913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523ef9d-f844-485d-8a64-82c492260551 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.649966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 263/524] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:15:34 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:34.650804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523ef9d-f844-485d-8a64-82c492260551 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.676188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4faf49-433e-4715-b05b-d07fa0a842cf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.717549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.718522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.718810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.719225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.727631 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.729182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:34.746127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:34.747710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 262/525] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:34.748542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.761153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:34.779296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523ef9d-f844-485d-8a64-82c492260551 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.805442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:34.818580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.819420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.819702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.819973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.832740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.834379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:34.854993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:34.856158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:34.857576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:34.857576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:34.857576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:34.857576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:34.857576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 264/526] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:34.857576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.880699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14f01-0ea4-45df-b4f5-949445e1a141 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:34.915857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:34.916649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:34.917002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:34.917359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:34.918230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:34.918545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:34.920043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:34.947077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 263/527] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:34.947472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:34.968497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa338be3-a635-40ea-8e0f-4d9841fdda65 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.006402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.007137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.007415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.007683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.008521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:35.009033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.010265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.029158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 265/528] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:35.029894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.032694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:35.053211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:35.058440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67012e0-a3c6-4804-933d-599ffd6d58aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.094558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.095260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.095771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.095904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.096592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:35.096901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.098379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.111097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 264/529] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:35.112118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.144620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab40fc-1d4e-4db2-a440-4beb5f825358 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.181898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.182572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.182855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.183160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.183892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:35.184202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.185606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.197855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 266/530] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:35.198601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.231641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9653a58-1bec-42e5-9dcc-e222bae284d8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.266076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:35.268207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.268958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.269244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.269597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.270600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=29c52f8ffcc34046ac3ade9723bf8b89) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:35.270946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.273015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.278687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 265/531] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/role_assignments?user.id=29c52f8ffcc34046ac3ade9723bf8b89&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:35.279519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.318621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:35.320340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbed31f-9204-4aea-98c6-c991eba16f71 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.371439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f70f8-ee19-4cd6-96e4-1f39c10f7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.372698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f70f8-ee19-4cd6-96e4-1f39c10f7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.373224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f70f8-ee19-4cd6-96e4-1f39c10f7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.373779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f70f8-ee19-4cd6-96e4-1f39c10f7ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.406572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c26331-7a04-4ddf-b183-eccd098d5064 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.444799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.445483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.446019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.446019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.446887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=0ac481e3d57a4b6fa07c120ca26f2e2b) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:35.447231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.449499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.456989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f70f8-ee19-4cd6-96e4-1f39c10f7ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.458513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f70f8-ee19-4cd6-96e4-1f39c10f7ee1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.463395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 266/532] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/role_assignments?user.id=0ac481e3d57a4b6fa07c120ca26f2e2b&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:35.464419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.529646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:35.568905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 267/533] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:35.574826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f70f8-ee19-4cd6-96e4-1f39c10f7ee1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.627241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:35.660585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445990a1-d45c-4da8-96bc-595e84228e4d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.697045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.697867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.698152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.698424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.706285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.707708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:35.734494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:35.736135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:35.737666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:35.737666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:35.737666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:35.737666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:35.737666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:35.737666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:35.737666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:35.737666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:35.740349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f70f8-ee19-4cd6-96e4-1f39c10f7ee1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.743090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 267/534] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:35.751946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.804515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.805817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.806289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.806823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.826595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.829604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:35.865344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:35.867080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:35.869991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:35.869991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:35.869991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:35.869991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:35.870406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a0254-ff8a-49bd-a70a-8bee2eec2479 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:35.870549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 268/535] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:35.879068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.915730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:35.916417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:35.916701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:35.916993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:35.917736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:35.917890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:35.918147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:35.919764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:35.945130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 268/536] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:35.964202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:35.985855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:36.069882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b6e1-dcca-42fc-b52e-2e0fdd54420d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:36.130203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:36.130920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:36.131233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:36.134533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:36.135321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:36.135642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:36.137062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:36.158556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d537de-428f-4e27-9e54-c5f85380e09b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:36.162174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 269/537] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:36.169611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:36.228102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:36.228678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:36.228956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:36.229227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:36.230069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=fc8b95ffc2324085bc736a6fa10f73f8) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:36.230380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:36.231895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:36.246762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 269/538] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:35 2022] GET /identity/v3/role_assignments?user.id=fc8b95ffc2324085bc736a6fa10f73f8&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:36.312159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:36.349811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f8a0-742d-4a82-a3c7-47c2622899f7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:36.396778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:36.397990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:36.398374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:36.398750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:36.415971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:36.417682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:36.433793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:36.435002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:36.435968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:36.435968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:36.435968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:36.435968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:36.435968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:36.435968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:36.435968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:36.435968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:36.437106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 270/539] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:36.442683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:36.524058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:36.549577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113ca2c-9202-4f59-8e32-0b2f824c3455 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:36.584153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455c42-4fd3-4fbc-a5c8-5cc044ffeeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:36.584826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455c42-4fd3-4fbc-a5c8-5cc044ffeeaf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:36.585169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455c42-4fd3-4fbc-a5c8-5cc044ffeeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:36.585446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455c42-4fd3-4fbc-a5c8-5cc044ffeeaf None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:36.586250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07455c42-4fd3-4fbc-a5c8-5cc044ffeeaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:36.586555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07455c42-4fd3-4fbc-a5c8-5cc044ffeeaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:36.588058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07455c42-4fd3-4fbc-a5c8-5cc044ffeeaf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:36.600765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 270/540] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:36.606792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:36.723155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f36e-bc75-437a-9cda-8dc4c72d1e7f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:36.767297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9de61-5637-43f9-aeb5-441cf7281e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:36.767966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9de61-5637-43f9-aeb5-441cf7281e8e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:36.768249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9de61-5637-43f9-aeb5-441cf7281e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:36.768528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9de61-5637-43f9-aeb5-441cf7281e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:36.769429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9de61-5637-43f9-aeb5-441cf7281e8e None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=3894e1d2983e4040a4b0ae92ce794f89) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:36.769741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9de61-5637-43f9-aeb5-441cf7281e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:36.771268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9de61-5637-43f9-aeb5-441cf7281e8e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:36.773139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:36.782059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 271/541] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:36 2022] GET /identity/v3/role_assignments?user.id=3894e1d2983e4040a4b0ae92ce794f89&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:36.820924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3585c-daa4-43f0-8f17-b44ac3e785b2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:36.821244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3585c-daa4-43f0-8f17-b44ac3e785b2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:36.821485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3585c-daa4-43f0-8f17-b44ac3e785b2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:36.823070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 271/542] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:36.828982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0c55-0532-4f3d-8162-ef9691a259ab None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:36.829621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0c55-0532-4f3d-8162-ef9691a259ab None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:36.830094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff0c55-0532-4f3d-8162-ef9691a259ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:36.855709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-98ff0c55-0532-4f3d-8162-ef9691a259ab None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:36.857374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-98ff0c55-0532-4f3d-8162-ef9691a259ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:36.965774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 272/543] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:36.991175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3585c-daa4-43f0-8f17-b44ac3e785b2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:37.120168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3585c-daa4-43f0-8f17-b44ac3e785b2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:37.151333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:37.160165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86066-8909-41ab-9142-ce4bd1adba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:37.161166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86066-8909-41ab-9142-ce4bd1adba6f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:37.167279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86066-8909-41ab-9142-ce4bd1adba6f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:37.167569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86066-8909-41ab-9142-ce4bd1adba6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:37.178671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c86066-8909-41ab-9142-ce4bd1adba6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-46c86066-8909-41ab-9142-ce4bd1adba6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:37.186658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:37.187580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:37.188376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:37.195141 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 272/544] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:37.196535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff0c55-0532-4f3d-8162-ef9691a259ab None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:37.343843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff0c55-0532-4f3d-8162-ef9691a259ab None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:37.384032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:37.392362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:37.393042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:37.393323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:37.393603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:37.394409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:37.394715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:37.396154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:37.405618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 273/545] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:37.410861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86066-8909-41ab-9142-ce4bd1adba6f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:37.553684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86066-8909-41ab-9142-ce4bd1adba6f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:37.605478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:37.606698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:37.607207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:37.608371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:37.625025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:37.626532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:37.651970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:37.652846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:37.653684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:37.653684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:37.653684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:37.653684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:37.653684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 273/546] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:37.659217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:37.818810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727580f-63a8-4674-bb93-8a3caeb5a5b9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:37.866959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b43df-99b0-45b3-aac5-9978fdb7ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:37.868012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b43df-99b0-45b3-aac5-9978fdb7ef10 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:37.868512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b43df-99b0-45b3-aac5-9978fdb7ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:37.868992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b43df-99b0-45b3-aac5-9978fdb7ef10 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:37.870305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b43df-99b0-45b3-aac5-9978fdb7ef10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:37.870812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b43df-99b0-45b3-aac5-9978fdb7ef10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:37.872574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b43df-99b0-45b3-aac5-9978fdb7ef10 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:37.885762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 274/547] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:37.891064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:37.986814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:38.032068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edfd78-943c-4098-ac1b-f5537bb065a7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.032694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edfd78-943c-4098-ac1b-f5537bb065a7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.033162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edfd78-943c-4098-ac1b-f5537bb065a7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.035036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 275/548] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:15:38.040438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af06f4-1ed9-4d6c-9819-acaea10135b4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.040730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af06f4-1ed9-4d6c-9819-acaea10135b4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.041006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af06f4-1ed9-4d6c-9819-acaea10135b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.060141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-54af06f4-1ed9-4d6c-9819-acaea10135b4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:38.061351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-54af06f4-1ed9-4d6c-9819-acaea10135b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:38.087444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c754b-0e30-4abc-befe-934070d3e67e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.130476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783d4c6-88d9-4b2e-9786-b6f9fef30c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:38.130684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d4c6-88d9-4b2e-9786-b6f9fef30c7a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.130945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d4c6-88d9-4b2e-9786-b6f9fef30c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.131226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d4c6-88d9-4b2e-9786-b6f9fef30c7a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.139596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783d4c6-88d9-4b2e-9786-b6f9fef30c7a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:38.141169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783d4c6-88d9-4b2e-9786-b6f9fef30c7a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:38.143063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4783d4c6-88d9-4b2e-9786-b6f9fef30c7a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:38.156316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:38.157817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:38.158877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 274/549] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:38.164451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259e79-31e4-4c3c-998c-962a7d7d196f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.165094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259e79-31e4-4c3c-998c-962a7d7d196f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.165094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259e79-31e4-4c3c-998c-962a7d7d196f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.166877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 275/550] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:38.170912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259e79-31e4-4c3c-998c-962a7d7d196f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:38.177309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 276/551] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:38.179052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79223-7d17-4f1a-ab14-22d1b72c1769 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.179515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79223-7d17-4f1a-ab14-22d1b72c1769 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.180090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79223-7d17-4f1a-ab14-22d1b72c1769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.197747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-eff79223-7d17-4f1a-ab14-22d1b72c1769 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:38.199980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eff79223-7d17-4f1a-ab14-22d1b72c1769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:38.279106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 277/552] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:38.280475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff79223-7d17-4f1a-ab14-22d1b72c1769 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:38.281280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259e79-31e4-4c3c-998c-962a7d7d196f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.283319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:38.321686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:38.322753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.323231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.323667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.324746 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:38.325234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:38.326915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:38.345586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 276/553] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:38.351117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:38.397715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff79223-7d17-4f1a-ab14-22d1b72c1769 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.409101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:38.432021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a42e54-93a9-4741-a7cf-31a3ee1a1674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:38.432869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a42e54-93a9-4741-a7cf-31a3ee1a1674 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.433189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a42e54-93a9-4741-a7cf-31a3ee1a1674 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.433534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a42e54-93a9-4741-a7cf-31a3ee1a1674 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.444787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a42e54-93a9-4741-a7cf-31a3ee1a1674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-76a42e54-93a9-4741-a7cf-31a3ee1a1674 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:38.453070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:38.454071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:38.454886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 278/554] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:38.455609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a42e54-93a9-4741-a7cf-31a3ee1a1674 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:38.472440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec736f-2d47-442d-bbc6-528c8c314afd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.516992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f953522-c9ba-4a6a-a67f-b669a686f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:38.518547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953522-c9ba-4a6a-a67f-b669a686f337 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.519138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953522-c9ba-4a6a-a67f-b669a686f337 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.519558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953522-c9ba-4a6a-a67f-b669a686f337 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.533383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f953522-c9ba-4a6a-a67f-b669a686f337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6f953522-c9ba-4a6a-a67f-b669a686f337 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:38.543225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:38.544160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:38.545052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:38.547410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 277/555] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:38.548352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f953522-c9ba-4a6a-a67f-b669a686f337 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:38.563366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a42e54-93a9-4741-a7cf-31a3ee1a1674 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.571641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:38.601836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54978d-3aeb-4d05-8733-35d93e3b5a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:38.602497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54978d-3aeb-4d05-8733-35d93e3b5a43 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.602784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54978d-3aeb-4d05-8733-35d93e3b5a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.603094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54978d-3aeb-4d05-8733-35d93e3b5a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.647432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:38.653569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f953522-c9ba-4a6a-a67f-b669a686f337 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.681537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54978d-3aeb-4d05-8733-35d93e3b5a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:38.683076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54978d-3aeb-4d05-8733-35d93e3b5a43 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:38.689642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:38.690611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.691129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.691618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.692582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:38.693094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:38.694731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:38.703840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 278/556] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:38.705040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:38.792877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:38.793777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 279/557] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:38.794899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54978d-3aeb-4d05-8733-35d93e3b5a43 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:38.818763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19f81d-e719-47fc-b8b9-4d145b14f354 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.862445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:38.863355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.863740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.864195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.865006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:38.865383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:38.866946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:38.876432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 279/558] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:38.877287 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:38.879603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:38.915155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54978d-3aeb-4d05-8733-35d93e3b5a43 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.959045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:38.959045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:38.959045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:38.959045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:38.969137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:38.970856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:38.981835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee9358-4179-49e6-a372-78ec2ee6d0c4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:38.989681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:38.990599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:38.992192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:38.992192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:38.992192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:38.992192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:38.992192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 280/559] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:38.992192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.018143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.018957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.019348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.019625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.031000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:39.032559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:39.035238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:39.051549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:39.052788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:39.053910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:39.053910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:39.053910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:39.053910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:39.059366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 280/560] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:39.060398 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.104915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0e09-07b9-4395-97d2-f2ce41531969 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.132617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:39.147697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85902-bf80-448e-887f-9f29dbd517c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.148518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85902-bf80-448e-887f-9f29dbd517c1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.148796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85902-bf80-448e-887f-9f29dbd517c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.149065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85902-bf80-448e-887f-9f29dbd517c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.161168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85902-bf80-448e-887f-9f29dbd517c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:39.162662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85902-bf80-448e-887f-9f29dbd517c1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:39.165937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af23e3-46af-4fb0-aa9e-8cddf208cc0a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-70b85902-bf80-448e-887f-9f29dbd517c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:39.180519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:39.181639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:39.182540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:39.182540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:39.182540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:39.182540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:39.182540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 281/561] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:39.183082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee251-7fa1-4a11-af32-6eafb023ed88 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.183292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee251-7fa1-4a11-af32-6eafb023ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.183586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ee251-7fa1-4a11-af32-6eafb023ed88 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.184819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 282/562] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:39.185509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ee251-7fa1-4a11-af32-6eafb023ed88 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.203127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a0f4-79d7-4cd0-8aa6-34b734c0e2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.203805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a0f4-79d7-4cd0-8aa6-34b734c0e2ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.204083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a0f4-79d7-4cd0-8aa6-34b734c0e2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.204414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a0f4-79d7-4cd0-8aa6-34b734c0e2ea None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.205257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a0f4-79d7-4cd0-8aa6-34b734c0e2ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:39.205721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a0f4-79d7-4cd0-8aa6-34b734c0e2ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:39.207380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a0f4-79d7-4cd0-8aa6-34b734c0e2ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:39.219875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 281/563] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:39.221030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319747c-cac8-44c1-9ffc-1109aa991e03 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.221312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319747c-cac8-44c1-9ffc-1109aa991e03 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.221738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319747c-cac8-44c1-9ffc-1109aa991e03 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.222927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 282/564] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:39.223691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319747c-cac8-44c1-9ffc-1109aa991e03 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.284512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:39.296829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ee251-7fa1-4a11-af32-6eafb023ed88 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.329043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319747c-cac8-44c1-9ffc-1109aa991e03 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.331485 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fab6d-f289-4653-9e5e-ca1fc150690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.332160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fab6d-f289-4653-9e5e-ca1fc150690a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.332445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fab6d-f289-4653-9e5e-ca1fc150690a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.332721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fab6d-f289-4653-9e5e-ca1fc150690a None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.333450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fab6d-f289-4653-9e5e-ca1fc150690a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:39.333758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fab6d-f289-4653-9e5e-ca1fc150690a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:39.335218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fab6d-f289-4653-9e5e-ca1fc150690a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:39.347608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 283/565] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:39.349208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf7c1-c4c2-4297-85e3-40e442f1cbbb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.349520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf7c1-c4c2-4297-85e3-40e442f1cbbb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.349800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf7c1-c4c2-4297-85e3-40e442f1cbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.366021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1d6bf7c1-c4c2-4297-85e3-40e442f1cbbb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:39.367299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1d6bf7c1-c4c2-4297-85e3-40e442f1cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:39.367539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.368219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.368501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.368773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.369500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:39.370167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:39.371588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:39.383148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 283/566] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:39.383933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.394255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:39.441076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 284/567] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:39.442428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f214b3-b647-4f48-9a4b-f40e49d8c84c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.442719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f214b3-b647-4f48-9a4b-f40e49d8c84c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.443043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f214b3-b647-4f48-9a4b-f40e49d8c84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.459190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f4f214b3-b647-4f48-9a4b-f40e49d8c84c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:39.460432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f4f214b3-b647-4f48-9a4b-f40e49d8c84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:39.498674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad97dda-3fad-4301-995f-e7537507d05a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.514082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:39.528675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 285/568] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:39.529610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f214b3-b647-4f48-9a4b-f40e49d8c84c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.551552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.552362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.552642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.552918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.561335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:39.562793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:39.576844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:39.577967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 284/569] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:39.578903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.626280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:39.634093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f214b3-b647-4f48-9a4b-f40e49d8c84c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.671136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.671939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.672218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.672488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.679343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:39.680823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:39.684841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509c6f7-f126-491a-a370-1b45561ec150 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:39.694320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:39.695366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:39.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 286/570] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:39.696820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.722021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.722828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.723154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.723428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.731495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:39.732964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:39.747704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:39.748788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 285/571] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:39.749727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.785627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:39.805763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586c6ba-8e57-4467-b260-f2db61ee8d45 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.838664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b2e26-35ea-4aec-b85c-3344ccd9827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.839487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2e26-35ea-4aec-b85c-3344ccd9827f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.839762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2e26-35ea-4aec-b85c-3344ccd9827f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.840045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2e26-35ea-4aec-b85c-3344ccd9827f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.849592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5059-382e-4b6f-9287-1f3e2f6786b0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:39.849814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b2e26-35ea-4aec-b85c-3344ccd9827f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0f4b2e26-35ea-4aec-b85c-3344ccd9827f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:39.857611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:39.858668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:39.859524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 287/572] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:39.860206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b2e26-35ea-4aec-b85c-3344ccd9827f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.875587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:39.890321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba4d09-daac-4b03-9e5e-b18665d1f458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:39.891180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba4d09-daac-4b03-9e5e-b18665d1f458 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:39.891463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba4d09-daac-4b03-9e5e-b18665d1f458 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:39.891733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba4d09-daac-4b03-9e5e-b18665d1f458 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:39.902104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba4d09-daac-4b03-9e5e-b18665d1f458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-caba4d09-daac-4b03-9e5e-b18665d1f458 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:39.909869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:39.910834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:39.911683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 286/573] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:39.912418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba4d09-daac-4b03-9e5e-b18665d1f458 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:39.964706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b2e26-35ea-4aec-b85c-3344ccd9827f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.002168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.002773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.003100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.003376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.004224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.004535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.005997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.017246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:40.023655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 288/574] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:40.024264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba4d09-daac-4b03-9e5e-b18665d1f458 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.024474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.059043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.059705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.059977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.060250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.061041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.061348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.062785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.074701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 287/575] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:40.075513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.094913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:40.125050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c109e7-5b43-46d3-922d-76fbf53464b7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.157596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.158278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.158554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.158832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.159712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.160024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.161475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.173414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce5a8-8380-4e0a-abfb-f2558ceba692 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.179019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 289/576] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:40.179905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.211683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.212361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.212646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.212922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.213670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.213980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.215407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.223364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 288/577] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:40.224132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.243734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:40.278418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a89b-4f9e-446f-b4f4-877869e70857 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.305927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:40.312045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.312725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.313032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.313305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.314054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.314362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.315793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.323657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 290/578] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:40.324414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39534f64-e0eb-434d-9f40-77a3dd7ed4b2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.324548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.360430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.361231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.361510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.361781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.372508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.373966 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:40.390551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:40.391561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:40.392910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:40.392910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:40.392910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:40.392910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:40.392910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 289/579] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:40.392910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.433189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad74bd-0ace-470b-a799-4f3748cf44c7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.467084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:40.467504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.468254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.468442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.468712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.469569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=8db8ce1a1d9143c491304d0b72ace736) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.469869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.471342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.476839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 291/580] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/role_assignments?user.id=8db8ce1a1d9143c491304d0b72ace736&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:40.477615 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.515282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c8c61-efe2-44bb-bf71-1d660f22e39f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.542012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:40.557174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.558531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.558814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.559133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.571752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.573263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.589362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd409d-889e-4be2-8a58-d0cde63e2099 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:40.592578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:40.593485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:40.594428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:40.594428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:40.594428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:40.594428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:40.594428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 290/581] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:40.595228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.631535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.633133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.633410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.633688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.653027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.654511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:40.672198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:40.673119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:40.673982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:40.673982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:40.673982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:40.673982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:40.673982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 292/582] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:40.674551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.707553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7042907-f464-463a-aabd-a61b0761078c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.731457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:40.746875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.748515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.748797 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.749072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.763495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.764989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.777467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4b55c-c9c3-4075-8cf8-4cd2365ad90f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.786504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:40.787472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:40.788431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:40.789322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:40.789322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:40.789322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:40.789322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:40.791142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 291/583] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:40.792703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.817629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.818431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.819074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.819241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.819851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.820156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.821794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.835516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 293/584] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:40.836416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.908590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd891bb-50f9-42f7-967e-30d94b1300fb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.946820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.947520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.947801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.948074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.948804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.948898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2869992-d7e4-4895-8c95-32002f37c6f1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:40.949109 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.950491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:40.964230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 292/585] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:40.965174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:40.991251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:40.992330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:40.992880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:40.993163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:40.994139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:40.994477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:40.996897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.001164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:41.011258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 294/586] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:41.012337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.043114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:41.080057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a26117-0bc3-45d5-b77b-f93ede7bcc19 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.115006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.115685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.115964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.116343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.117072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:41.117377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.118765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.120529 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df76f-c3e1-4b65-9c16-20546bc94a9b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.131471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 293/587] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:41.132752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.154937 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.155790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.156064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.156339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.163359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.164827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:41.179215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:41.180276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:41.181363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:41.181363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:41.181363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:41.181363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:41.181363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:41.181363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:41.181363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:41.181363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:41.185010 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 295/588] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:41.185860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.233852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:41.241252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7af7f-8685-4b58-be3e-7639d854ff76 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.275342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.276144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.276424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.276700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.278856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:41.283731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.285199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.292559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79aca7-8fcd-4b30-a748-4d3709d3142d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:41.299382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:41.300251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:41.301116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 294/589] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:41.301678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.337507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.338314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.338596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.338868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.346090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.347597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:41.362862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:41.363862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:15:41.364780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:41.367379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 296/590] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:41.368582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.414330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cc834-23f5-4e07-94e2-6bacdf329b66 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.451511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.452329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.452611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.452886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.460754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.462212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:41.477655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:41.478786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 295/591] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:41.479989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.486013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61e3f-f387-4647-8afd-9f7c6d3f39e3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.497605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:41.523717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.524389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.524671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.524946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.525745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:41.526052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.527567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.545932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 297/592] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:41.546846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.558850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:41.599935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad72d2-ef0c-4ced-811e-9f49c2d63ca4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.641866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.642537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.642812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.643112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.643941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:41.644248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.645687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.662781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 296/593] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:41.663903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.666302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3ae1-758a-45da-b04b-7c3f8e855953 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.702441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.703373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.704206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.704723 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.706065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:41.706522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.708511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.731455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 298/594] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:41.732479 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.738081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:41.766952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb51a9-ac08-41a5-a1f5-376f2c36c3ea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.798174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:41.800426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.801673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.801955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.802228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.803112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:41.803414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.804920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.827100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 297/595] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:41.827100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.840043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff524-6d04-4883-93df-23dec9b0e60a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.875748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a2492-73a3-4e89-af54-08089742e502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:41.876650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a2492-73a3-4e89-af54-08089742e502 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:41.876926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a2492-73a3-4e89-af54-08089742e502 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:41.877194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a2492-73a3-4e89-af54-08089742e502 None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/29c52f8ffcc34046ac3ade9723bf8b89/roles/8a313a6550f146259cb001349ea432d9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:41.891956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a2492-73a3-4e89-af54-08089742e502 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=29c52f8ffcc34046ac3ade9723bf8b89, role_id=8a313a6550f146259cb001349ea432d9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:41.893419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a2492-73a3-4e89-af54-08089742e502 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:41.907334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 299/596] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:41 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/29c52f8ffcc34046ac3ade9723bf8b89/roles/8a313a6550f146259cb001349ea432d9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:41.908269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a2492-73a3-4e89-af54-08089742e502 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:41.937890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368887-c453-4c70-be65-cfb6dd2b4e13 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:41.988788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:42.000853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6bef-e2da-481a-8f8d-b7b31afca210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:42.002225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6bef-e2da-481a-8f8d-b7b31afca210 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.002697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6bef-e2da-481a-8f8d-b7b31afca210 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.003175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6bef-e2da-481a-8f8d-b7b31afca210 None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/0ac481e3d57a4b6fa07c120ca26f2e2b/roles/8a313a6550f146259cb001349ea432d9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.021705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6bef-e2da-481a-8f8d-b7b31afca210 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=0ac481e3d57a4b6fa07c120ca26f2e2b, role_id=8a313a6550f146259cb001349ea432d9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:42.023638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6bef-e2da-481a-8f8d-b7b31afca210 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:42.039982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 298/597] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:41 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/0ac481e3d57a4b6fa07c120ca26f2e2b/roles/8a313a6550f146259cb001349ea432d9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:42.041312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6bef-e2da-481a-8f8d-b7b31afca210 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:42.061409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a2492-73a3-4e89-af54-08089742e502 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:42.081218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:42.126268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:42.127252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.127601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.127947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.144695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:42.146233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:42.173758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6bef-e2da-481a-8f8d-b7b31afca210 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:42.183257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:42.184178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:42.185062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:42.185062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:42.185062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:42.185062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:42.185062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 300/598] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:42.196079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:42.228570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:42.229456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.229736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.230038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.256102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:42.257697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:42.282763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:42.283793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:42.284674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:42.284674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:42.284674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:42.284674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:42.284674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 299/599] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:42.290883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:42.354244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:42.368182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649b8e4-a6f3-4dc7-bb7f-b40b07acbc94 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:42.410815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:42.411524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.411809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.412234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.413346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:42.413660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:42.415535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:42.429311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 301/600] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:42.429511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170b437-f97a-4dde-b0a9-1c7df7bb6980 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:42.437280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:42.473135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:42.499692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:42.500638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.501065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.501484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.502363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:42.502838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:42.504410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:42.541307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 300/601] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:42.552012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:42.559536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3669858-108a-4aa5-b296-e9e8ecc3ec97 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:42.608166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045c7fe-c26c-482f-a10b-1b794fef6bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:42.609691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c7fe-c26c-482f-a10b-1b794fef6bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.610215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c7fe-c26c-482f-a10b-1b794fef6bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.610689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c7fe-c26c-482f-a10b-1b794fef6bd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.621913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045c7fe-c26c-482f-a10b-1b794fef6bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:42.623949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045c7fe-c26c-482f-a10b-1b794fef6bd5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7045c7fe-c26c-482f-a10b-1b794fef6bd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:42.640301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:42.641229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:42.642106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 302/602] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:42.643411 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ba49-6ea1-4961-8dda-66c04bfdd25f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.643699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ba49-6ea1-4961-8dda-66c04bfdd25f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.643975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ba49-6ea1-4961-8dda-66c04bfdd25f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.649762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 303/603] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:42.650566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7ba49-6ea1-4961-8dda-66c04bfdd25f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:42.666232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:42.676480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d14946-5147-411d-adde-4b7519887a70 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:42.722773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0280cb-3fa8-46d4-9017-772189225390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:42.724032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0280cb-3fa8-46d4-9017-772189225390 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.724516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0280cb-3fa8-46d4-9017-772189225390 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.724992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0280cb-3fa8-46d4-9017-772189225390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.732445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0280cb-3fa8-46d4-9017-772189225390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:42.734178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0280cb-3fa8-46d4-9017-772189225390 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:42.750679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ea0280cb-3fa8-46d4-9017-772189225390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:42.756494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:42.757477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:42.758374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 301/604] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:42.760069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1a23-0d60-4e1f-a095-2a70760aa147 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.760356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1a23-0d60-4e1f-a095-2a70760aa147 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.760771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1a23-0d60-4e1f-a095-2a70760aa147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.767309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7ba49-6ea1-4961-8dda-66c04bfdd25f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:42.782655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f37e1a23-0d60-4e1f-a095-2a70760aa147 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:42.783911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f37e1a23-0d60-4e1f-a095-2a70760aa147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:42.810758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:42.811687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:42.811968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:42.812638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:42.813690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:42.813998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:42.816378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:42.832533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 304/605] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:42.833619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:42.856791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 302/606] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:42.863844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e1a23-0d60-4e1f-a095-2a70760aa147 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:42.961581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acbb83-9b1f-4af5-b168-978522e0b9cb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:42.964776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:42.983126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e1a23-0d60-4e1f-a095-2a70760aa147 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:43.013797 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:43.014998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:43.015785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:43.016228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:43.017412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:43.017928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:43.019700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:43.020740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0283ce-78c4-4d43-a3d6-41d6be716f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:43.021772 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0283ce-78c4-4d43-a3d6-41d6be716f8a None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:43.022147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0283ce-78c4-4d43-a3d6-41d6be716f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:43.022577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0283ce-78c4-4d43-a3d6-41d6be716f8a None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/fc8b95ffc2324085bc736a6fa10f73f8/roles/8a313a6550f146259cb001349ea432d9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:43.036115 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 305/607] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:43.037584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:43.038778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0283ce-78c4-4d43-a3d6-41d6be716f8a None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=fc8b95ffc2324085bc736a6fa10f73f8, role_id=8a313a6550f146259cb001349ea432d9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:43.040575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0283ce-78c4-4d43-a3d6-41d6be716f8a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:43.051769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:43.061014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 303/608] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:42 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/fc8b95ffc2324085bc736a6fa10f73f8/roles/8a313a6550f146259cb001349ea432d9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:43.062072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0283ce-78c4-4d43-a3d6-41d6be716f8a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:43.154948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b36962-ba5e-48fd-aee5-7d6caab71558 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:43.176331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0283ce-78c4-4d43-a3d6-41d6be716f8a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:43.193639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea164e-9e9b-44e4-8768-63e9e8bae203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:43.194915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea164e-9e9b-44e4-8768-63e9e8bae203 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:43.195519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea164e-9e9b-44e4-8768-63e9e8bae203 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:43.195980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea164e-9e9b-44e4-8768-63e9e8bae203 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:43.207666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea164e-9e9b-44e4-8768-63e9e8bae203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:43.214410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d62d-f1bc-4c0c-a6f2-7ebb4dddbe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:43.215359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d62d-f1bc-4c0c-a6f2-7ebb4dddbe5d None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:43.215642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d62d-f1bc-4c0c-a6f2-7ebb4dddbe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:43.215913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d62d-f1bc-4c0c-a6f2-7ebb4dddbe5d None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/3894e1d2983e4040a4b0ae92ce794f89/roles/8a313a6550f146259cb001349ea432d9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f2ea164e-9e9b-44e4-8768-63e9e8bae203 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:43.217690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:43.218680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:43.219557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:43.220977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:43.223263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 306/609] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:43.236349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea164e-9e9b-44e4-8768-63e9e8bae203 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:43.253361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d62d-f1bc-4c0c-a6f2-7ebb4dddbe5d None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=3894e1d2983e4040a4b0ae92ce794f89, role_id=8a313a6550f146259cb001349ea432d9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:43.256256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d62d-f1bc-4c0c-a6f2-7ebb4dddbe5d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:43.285218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 304/610] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:43 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/3894e1d2983e4040a4b0ae92ce794f89/roles/8a313a6550f146259cb001349ea432d9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:43.379942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:43.441468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea164e-9e9b-44e4-8768-63e9e8bae203 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:43.491958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:43.493082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:43.493374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:43.493660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:43.494437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:43.495144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:43.496573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:43.507672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 307/611] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:43.514237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d62d-f1bc-4c0c-a6f2-7ebb4dddbe5d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:43.631922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d62d-f1bc-4c0c-a6f2-7ebb4dddbe5d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:43.672409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:43.673602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:43.674075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:43.674532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:43.689434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:43.691305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:43.710189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:43.711127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:43.712013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:43.712013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:43.712013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:43.712013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:43.714275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 305/612] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:43.720290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:43.902994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720f354-23fc-4800-a532-808d0a83691b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:43.933011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:43.939345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:43.940238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:43.940534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:43.941048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:43.942053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:43.942692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:43.944543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:43.957704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 308/613] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:43.963520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:44.004115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:44.096426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284649e-f965-43eb-963e-5955178f6aba None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:44.147928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:44.148897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.149318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.149690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.162266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:44.163816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:44.181443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:44.182379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:44.183349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 306/614] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:44.192117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:44.347476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718fd0d-a100-4abb-b7f8-6f98e5eb82e4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:44.401467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578a184-194e-48a0-b9e1-8b19882a273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:44.402935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a184-194e-48a0-b9e1-8b19882a273e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.403407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a184-194e-48a0-b9e1-8b19882a273e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.403847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a184-194e-48a0-b9e1-8b19882a273e None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.404859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578a184-194e-48a0-b9e1-8b19882a273e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:44.405355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578a184-194e-48a0-b9e1-8b19882a273e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:44.406999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578a184-194e-48a0-b9e1-8b19882a273e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:44.434391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 309/615] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jul 20 15:15:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:44.440053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:44.571140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2173d8f-4588-4cd5-bd0f-679767e7a81a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.571443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2173d8f-4588-4cd5-bd0f-679767e7a81a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.571699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2173d8f-4588-4cd5-bd0f-679767e7a81a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.573319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 310/616] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:15:44.574061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:44.578172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044df57-8809-4b30-91bc-be8e203ae17c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.578461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044df57-8809-4b30-91bc-be8e203ae17c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.578743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044df57-8809-4b30-91bc-be8e203ae17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.581261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86ed0-250f-4c61-a3c2-778238cb45c9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:44.595384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f044df57-8809-4b30-91bc-be8e203ae17c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:44.596575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f044df57-8809-4b30-91bc-be8e203ae17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:44.642570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:44.643331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.643608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.643876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.664718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:44.665366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:44.666199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:44.694739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:44.695719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:44.696591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:44.696591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:44.696591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:44.696591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:44.696591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 307/617] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:44.701471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:44.715313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 311/618] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:44.746957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044df57-8809-4b30-91bc-be8e203ae17c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:44.859941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f6f1-8ad9-4ffe-a56d-8090c85feec2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:44.874358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044df57-8809-4b30-91bc-be8e203ae17c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:44.907413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1724d-4207-4abe-82fc-81fc339b986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:44.908106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1724d-4207-4abe-82fc-81fc339b986f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.908394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1724d-4207-4abe-82fc-81fc339b986f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.908674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1724d-4207-4abe-82fc-81fc339b986f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.909497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1724d-4207-4abe-82fc-81fc339b986f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:44.909807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1724d-4207-4abe-82fc-81fc339b986f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:44.910348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedf806-16f7-4c44-bde0-d99b8eed5b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:44.911238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1724d-4207-4abe-82fc-81fc339b986f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:44.911599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedf806-16f7-4c44-bde0-d99b8eed5b5f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.912052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedf806-16f7-4c44-bde0-d99b8eed5b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.912508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedf806-16f7-4c44-bde0-d99b8eed5b5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.923249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedf806-16f7-4c44-bde0-d99b8eed5b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:44.925528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 308/619] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:44.926907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d359f3-e1dc-4049-811e-c6453965158d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.927226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d359f3-e1dc-4049-811e-c6453965158d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.927504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d359f3-e1dc-4049-811e-c6453965158d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4bedf806-16f7-4c44-bde0-d99b8eed5b5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:44.932210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:44.933295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:44.934139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:44.934778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 309/620] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:44.934778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d359f3-e1dc-4049-811e-c6453965158d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:44.937011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 312/621] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:44.943309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7e63-bc32-46cc-981b-d8ede08d4c80 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:44.943913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7e63-bc32-46cc-981b-d8ede08d4c80 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:44.944640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7e63-bc32-46cc-981b-d8ede08d4c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:44.947117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:44.965080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-107b7e63-bc32-46cc-981b-d8ede08d4c80 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:44.966454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-107b7e63-bc32-46cc-981b-d8ede08d4c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:45.002145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:45.055058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 313/622] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:45.056329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7e63-bc32-46cc-981b-d8ede08d4c80 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.067598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d359f3-e1dc-4049-811e-c6453965158d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.115650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.116904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.117387 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.117861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.125486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:45.127299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:45.142230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:45.143225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:45.144151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:45.144151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:45.144151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:45.144151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:45.144151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:45.144151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:45.144151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:45.144151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:45.146760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 310/623] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:45.147808 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.199814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7e63-bc32-46cc-981b-d8ede08d4c80 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.218520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:45.246390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.247462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.247982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.248459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.249406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:45.250084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:45.251837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:45.259474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc633e6-1688-469b-a74f-093c44fd0529 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.265742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 314/624] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:45.266914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.299067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:45.304290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd8002-bf71-4fbe-830f-5b6f2b95e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.305926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8002-bf71-4fbe-830f-5b6f2b95e584 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.306211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8002-bf71-4fbe-830f-5b6f2b95e584 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.306486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8002-bf71-4fbe-830f-5b6f2b95e584 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.321041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd8002-bf71-4fbe-830f-5b6f2b95e584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-63bd8002-bf71-4fbe-830f-5b6f2b95e584 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:45.331325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:45.332275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:45.333134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:45.337674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 311/625] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:45.339431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd8002-bf71-4fbe-830f-5b6f2b95e584 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.384831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133141b9-1b40-4808-9642-aecb8f026641 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.423440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.424124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.424369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.424634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.425428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:45.425731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:45.427223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:45.440707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 315/626] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:45.441658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.478130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd8002-bf71-4fbe-830f-5b6f2b95e584 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.518466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:45.529086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.530388 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.530864 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.531784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.540711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:45.548020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:45.550488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:45.552737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afedd2-fd5d-491e-b70d-30cc044706b5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:45.573009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:45.574161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:45.575246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:45.575246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:45.575246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:45.575246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:45.577481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 312/627] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:45.578404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.609119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.610095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.610653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.611133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.612581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:45.613056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:45.614849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:45.626337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 316/628] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:45.627541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.692500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a46a-708d-4a09-927b-41a070434e35 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.733996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d296ce4-a70f-4eef-bd35-8fb34f9b2d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.735325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296ce4-a70f-4eef-bd35-8fb34f9b2d96 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.735614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296ce4-a70f-4eef-bd35-8fb34f9b2d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.735890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d296ce4-a70f-4eef-bd35-8fb34f9b2d96 None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/8db8ce1a1d9143c491304d0b72ace736/roles/8a313a6550f146259cb001349ea432d9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.750569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7dc3-efc7-4760-949f-b881bba5294c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.753040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d296ce4-a70f-4eef-bd35-8fb34f9b2d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=8db8ce1a1d9143c491304d0b72ace736, role_id=8a313a6550f146259cb001349ea432d9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:45.754520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d296ce4-a70f-4eef-bd35-8fb34f9b2d96 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:45.768269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 313/629] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:45 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/8db8ce1a1d9143c491304d0b72ace736/roles/8a313a6550f146259cb001349ea432d9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:45.768956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d296ce4-a70f-4eef-bd35-8fb34f9b2d96 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.798204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48886216-8df3-43a5-8da5-cad009f682c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.799491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886216-8df3-43a5-8da5-cad009f682c3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.800199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886216-8df3-43a5-8da5-cad009f682c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.800624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886216-8df3-43a5-8da5-cad009f682c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.802271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886216-8df3-43a5-8da5-cad009f682c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:45.802753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886216-8df3-43a5-8da5-cad009f682c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:45.803613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:45.806522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886216-8df3-43a5-8da5-cad009f682c3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:45.827147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 317/630] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:45.827147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586edae3-df13-4ad2-aeb1-3bb52a1d06f9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.827147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586edae3-df13-4ad2-aeb1-3bb52a1d06f9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.827147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586edae3-df13-4ad2-aeb1-3bb52a1d06f9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.827147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 318/631] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:45.827627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f186c-ae1a-492b-9f82-9fa5b4fb9f0e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.828306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f186c-ae1a-492b-9f82-9fa5b4fb9f0e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.828306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f186c-ae1a-492b-9f82-9fa5b4fb9f0e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.829605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 319/632] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:45.830423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f186c-ae1a-492b-9f82-9fa5b4fb9f0e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:45.848276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:45.897139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d296ce4-a70f-4eef-bd35-8fb34f9b2d96 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.946742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e3ae8-1d02-4cc0-83be-158673cbd187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:45.947694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3ae8-1d02-4cc0-83be-158673cbd187 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.947972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3ae8-1d02-4cc0-83be-158673cbd187 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.948360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e3ae8-1d02-4cc0-83be-158673cbd187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:45.956638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f186c-ae1a-492b-9f82-9fa5b4fb9f0e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:45.960090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e3ae8-1d02-4cc0-83be-158673cbd187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:45.961564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e3ae8-1d02-4cc0-83be-158673cbd187 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-847e3ae8-1d02-4cc0-83be-158673cbd187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:45.980040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:45.981118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:45.981988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:45.981988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:45.981988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:45.981988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:45.981988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 314/633] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:45.983048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38885ff9-5f23-491a-93eb-a2bf42746a5c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:45.983165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38885ff9-5f23-491a-93eb-a2bf42746a5c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:45.983451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38885ff9-5f23-491a-93eb-a2bf42746a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.000804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-38885ff9-5f23-491a-93eb-a2bf42746a5c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:46.001228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c86d4d-f8e9-4098-a001-e083b71cbe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.001914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-38885ff9-5f23-491a-93eb-a2bf42746a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:46.002038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c86d4d-f8e9-4098-a001-e083b71cbe3d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.002309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c86d4d-f8e9-4098-a001-e083b71cbe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.002582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c86d4d-f8e9-4098-a001-e083b71cbe3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.010452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c86d4d-f8e9-4098-a001-e083b71cbe3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:46.011724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c86d4d-f8e9-4098-a001-e083b71cbe3d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-37c86d4d-f8e9-4098-a001-e083b71cbe3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:46.026434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:46.027528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:46.028534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 320/634] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:15:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:46.029138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838faa3-4ced-4c4d-af30-4e864da664b7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.029138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838faa3-4ced-4c4d-af30-4e864da664b7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.029820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838faa3-4ced-4c4d-af30-4e864da664b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.046413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6838faa3-4ced-4c4d-af30-4e864da664b7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:46.047621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6838faa3-4ced-4c4d-af30-4e864da664b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:46.083719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 315/635] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:46.084665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38885ff9-5f23-491a-93eb-a2bf42746a5c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.099474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:46.140366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 321/636] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:46.141631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838faa3-4ced-4c4d-af30-4e864da664b7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.144403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:46.197202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38885ff9-5f23-491a-93eb-a2bf42746a5c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.232632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.233309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.233592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.233873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.234611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:46.234920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:46.236375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:46.249788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 316/637] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:46.250513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.257004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838faa3-4ced-4c4d-af30-4e864da664b7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.293824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.294505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.294786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.295089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.295938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:46.296245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:46.297707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:46.316268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 322/638] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:46.317192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.324800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:46.357635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61fe1b-ae9d-410c-a9c9-c6e413c9f0d6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.383697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:46.394582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80671dd9-259e-47c8-8eec-3446b9827937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.395663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671dd9-259e-47c8-8eec-3446b9827937 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.395936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671dd9-259e-47c8-8eec-3446b9827937 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.396203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671dd9-259e-47c8-8eec-3446b9827937 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.407105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80671dd9-259e-47c8-8eec-3446b9827937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-80671dd9-259e-47c8-8eec-3446b9827937 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:46.415196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:46.416317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:46.417168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 317/639] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:46.418314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80671dd9-259e-47c8-8eec-3446b9827937 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.435074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9d3f2-a084-4fa4-baaa-61964a01c1da None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.475012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9f366-0fe3-4822-b03e-584d1d4a9f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.475905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9f366-0fe3-4822-b03e-584d1d4a9f80 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.476183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9f366-0fe3-4822-b03e-584d1d4a9f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.476457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9f366-0fe3-4822-b03e-584d1d4a9f80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.487802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9f366-0fe3-4822-b03e-584d1d4a9f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-cdc9f366-0fe3-4822-b03e-584d1d4a9f80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:46.496091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:46.497167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:46.498056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 323/640] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:46.498773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9f366-0fe3-4822-b03e-584d1d4a9f80 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.527320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80671dd9-259e-47c8-8eec-3446b9827937 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.556913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:46.563195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.564266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.564702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.564986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.575335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:46.576807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:46.596032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:46.597042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 318/641] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:46.603291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.603964 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9f366-0fe3-4822-b03e-584d1d4a9f80 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.625300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:46.641423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bae7-d36a-4f18-a44f-1e4130e9d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.642080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bae7-d36a-4f18-a44f-1e4130e9d229 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.642360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bae7-d36a-4f18-a44f-1e4130e9d229 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.642633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bae7-d36a-4f18-a44f-1e4130e9d229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.711342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2c64a-8cc6-4649-a57e-8d575abdf586 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.714133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987bae7-d36a-4f18-a44f-1e4130e9d229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:46.715523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987bae7-d36a-4f18-a44f-1e4130e9d229 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:46.746495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.747193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.747457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.747740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.748515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:46.748820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:46.750175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:46.759420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 319/642] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:46.760212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.817745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:46.825135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 324/643] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:46.826190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bae7-d36a-4f18-a44f-1e4130e9d229 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.850631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:46.868353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75d8fb-a6f2-4773-ae49-483fa34e31c4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.907751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.908434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.908714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.908982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.909732 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:46.910030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:46.911475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:46.919897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 320/644] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:46.920680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:46.937500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bae7-d36a-4f18-a44f-1e4130e9d229 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:46.974437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:46.975131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:46.975440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:46.975712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:46.976543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:46.976851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:46.978297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.001367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 325/645] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:47.001367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.038330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71960a8b-cad2-4b5b-a40c-3caed0b0f446 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.055872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:47.075655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.076391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.076675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.076955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.080897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:47.089303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.090827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.102656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765da02-ae61-4bea-bc92-e18dc43d2a16 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:47.108024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:47.108903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:47.114829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:47.114829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:47.114829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:47.114829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:47.114829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 321/646] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:47.114829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.145267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.146152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.146501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.146836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.159259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.160937 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:47.179818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:47.180848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:47.181965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:47.181965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:47.181965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:47.181965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:47.183946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 326/647] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:47.185062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.220404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8f793-22d1-46a0-8cc2-b7f1e2a3e636 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.255693 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.256524 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.256838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.257112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.268416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.269884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:47.286910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:47.287943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:47.288857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:47.288857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:47.288857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:47.288857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:47.288857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 322/648] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:47.289144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.295582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3834b-b197-45f4-b7cb-56862e4a4560 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.314255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:47.326301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:47.333154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0dc4a-ad30-4a5d-83cd-a1d0655bc7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.333811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0dc4a-ad30-4a5d-83cd-a1d0655bc7eb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.334171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0dc4a-ad30-4a5d-83cd-a1d0655bc7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.334439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0dc4a-ad30-4a5d-83cd-a1d0655bc7eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.399623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb24b42-2290-4690-a0b0-742f4f337f18 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.409438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0dc4a-ad30-4a5d-83cd-a1d0655bc7eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.410920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0dc4a-ad30-4a5d-83cd-a1d0655bc7eb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.445313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.445996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.446283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.446555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.447306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:47.447614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.449444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.463735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 323/649] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:47.468697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.516530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 327/650] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:47.518025 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0dc4a-ad30-4a5d-83cd-a1d0655bc7eb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.551764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:47.560847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:47.581290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813bf79-ec4f-439f-a7fb-6f962ef4bec9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.615890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.616587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.616866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.617135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.617851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:47.618153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.619932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.628623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0dc4a-ad30-4a5d-83cd-a1d0655bc7eb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.631412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 324/651] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:47.635910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.663797 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.664460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.664762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.665014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.665736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:47.666038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.667496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.679664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 328/652] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:47.683849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.748715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d8f6-3981-40f5-a3d7-54f4edf51075 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.786277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.787121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.787405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.787679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.791717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:47.797585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.799079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.802442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09ad1-2ba4-41fb-af97-bd9d0acb1e40 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.802891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:47.818843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:47.819998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 325/653] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:47.821479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.841229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.841965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.842244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.842516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.853364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.854910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:47.872372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:47.873439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:47.874550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:47.874550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:47.874550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:47.874550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:47.876874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 329/654] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:47.877878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:47.919955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7d09d-4c47-4161-8f54-e3b1ea4bbb44 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.955473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb25e9-b8c3-41c1-bcdc-4e667a97a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:47.956690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb25e9-b8c3-41c1-bcdc-4e667a97a78b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.956973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb25e9-b8c3-41c1-bcdc-4e667a97a78b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.957253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb25e9-b8c3-41c1-bcdc-4e667a97a78b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.964868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb25e9-b8c3-41c1-bcdc-4e667a97a78b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:47.966327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb25e9-b8c3-41c1-bcdc-4e667a97a78b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:47.979604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c70d54-2386-4f41-99af-9d5cc8f7e403 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-19eb25e9-b8c3-41c1-bcdc-4e667a97a78b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:47.980440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:47.981313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:47.982201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 326/655] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:47.982903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027babcc-f4bd-4bfb-952d-e717e79a57be None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:47.983270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027babcc-f4bd-4bfb-952d-e717e79a57be None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:47.983494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027babcc-f4bd-4bfb-952d-e717e79a57be None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:47.984722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 327/656] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:47.985406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027babcc-f4bd-4bfb-952d-e717e79a57be None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.019934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.020731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.021014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.021269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.028836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.030297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:48.044686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:48.045609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:15:48.046598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:48.047187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.047261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 330/657] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:48.047261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.049344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.093779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027babcc-f4bd-4bfb-952d-e717e79a57be None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.132840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.133522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.133812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.134075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.134927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:48.135268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.136723 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:48.159558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 328/658] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jul 20 15:15:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:48.159558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.159882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba9c4-622f-4ff1-bb75-65e422d2d082 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.193185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3891b-86d8-4923-a09d-cf3a521aabe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.193850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3891b-86d8-4923-a09d-cf3a521aabe5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.194215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3891b-86d8-4923-a09d-cf3a521aabe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.194491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3891b-86d8-4923-a09d-cf3a521aabe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.195250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3891b-86d8-4923-a09d-cf3a521aabe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:48.195558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3891b-86d8-4923-a09d-cf3a521aabe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.197389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3891b-86d8-4923-a09d-cf3a521aabe5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:48.209348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 331/659] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:48.210515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e5cc-30df-47b6-8826-8036ff48fa37 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.210817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e5cc-30df-47b6-8826-8036ff48fa37 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.211138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e5cc-30df-47b6-8826-8036ff48fa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.228665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-38c4e5cc-30df-47b6-8826-8036ff48fa37 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:48.229869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-38c4e5cc-30df-47b6-8826-8036ff48fa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:48.256569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b32570-08cd-4750-b8a9-9c994c9bfc82 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.275233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.286221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.293446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.294114 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.294387 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.294660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.295489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:48.295782 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.296981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 332/660] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:48.297207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:48.297796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e5cc-30df-47b6-8826-8036ff48fa37 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.308535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 329/661] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:48.309476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.406796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e5cc-30df-47b6-8826-8036ff48fa37 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.407042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb52f8-9d5d-47c3-9397-60f05beefa54 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.439872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a48a-8ed1-4454-a65c-fa25d2b4e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.440431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.440577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a48a-8ed1-4454-a65c-fa25d2b4e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.440796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a48a-8ed1-4454-a65c-fa25d2b4e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.441070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a48a-8ed1-4454-a65c-fa25d2b4e7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.441160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.441376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.441654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.442500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:48.442817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.444356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:48.462004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 333/662] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:48.462816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.486324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.510504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a48a-8ed1-4454-a65c-fa25d2b4e7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.512003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a48a-8ed1-4454-a65c-fa25d2b4e7ca None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:48.516569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.565721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d7578-ccf9-45cf-9081-da3c4acefca4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.599873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.600721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.601001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.601276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.607976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.608902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 330/663] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:48.609446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:48.609791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a48a-8ed1-4454-a65c-fa25d2b4e7ca None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:48.623917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:48.624948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 334/664] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:48.625833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.691692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.714541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a48a-8ed1-4454-a65c-fa25d2b4e7ca None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.726820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67a364-78da-42a2-9606-92b4c9f72ac0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.737660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.751045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.751732 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.752003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.752277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.753111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=29c52f8ffcc34046ac3ade9723bf8b89) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:48.753421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.754868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:48.760835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 331/665] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/role_assignments?user.id=29c52f8ffcc34046ac3ade9723bf8b89&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:48.761608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.762204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0073ec1-cb66-4606-bf50-852a8eea06f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.763033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073ec1-cb66-4606-bf50-852a8eea06f9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.763316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073ec1-cb66-4606-bf50-852a8eea06f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.763584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073ec1-cb66-4606-bf50-852a8eea06f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.783810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0073ec1-cb66-4606-bf50-852a8eea06f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a0073ec1-cb66-4606-bf50-852a8eea06f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:48.792567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:48.793605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:48.794438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 335/666] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:48.795185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0073ec1-cb66-4606-bf50-852a8eea06f9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:48.880630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3b03c-695b-4fe6-8880-626dc505f9c5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.915622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0073ec1-cb66-4606-bf50-852a8eea06f9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:48.921808 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a934-4b23-46ed-b4b8-bbb1b0b058ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.922688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a934-4b23-46ed-b4b8-bbb1b0b058ca None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.922993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a934-4b23-46ed-b4b8-bbb1b0b058ca None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.923262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a934-4b23-46ed-b4b8-bbb1b0b058ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.936477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:48.964193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:48.965028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:48.965865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:48.965865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:48.979277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:48.980870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:49.002410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:49.003494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:49.004585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:49.004585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:49.004585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:49.004585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:49.004801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508a934-4b23-46ed-b4b8-bbb1b0b058ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.004880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 336/667] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:49.004956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508a934-4b23-46ed-b4b8-bbb1b0b058ca None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.005308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.030379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:49.111521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba50d7-eca3-4766-aa60-34f02322913a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.112950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 332/668] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:49.113894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a934-4b23-46ed-b4b8-bbb1b0b058ca None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.152210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.152885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.153170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.153446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.154242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:49.154552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.156484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.159091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:49.175392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 337/669] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:49.175392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.223401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a934-4b23-46ed-b4b8-bbb1b0b058ca None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.260038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.260749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.261032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.261305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.262059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:49.262331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:49.262437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.263798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.276712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 333/670] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:49.276712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.286254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363911-e3eb-4d9f-9c99-c70bf8883c8b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.321867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.322541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.322829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.323143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.323867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:49.324177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.325568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.338592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 338/671] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:49.339708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.384598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da968f-2e19-40a1-bfec-92cf36166a9f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.387944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:49.421210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.422027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.422306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.422578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.434993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.436917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.445707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374813ba-e1c9-428a-90b4-047aa14d8ad9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:49.457158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:49.458064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:49.458954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:49.458954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:49.458954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:49.458954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:49.462873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 334/672] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:49.463714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.482631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.483271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.483564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.483832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.484673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=0ac481e3d57a4b6fa07c120ca26f2e2b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:49.484987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.486445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.492477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 339/673] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/role_assignments?user.id=0ac481e3d57a4b6fa07c120ca26f2e2b&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:49.493255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.503396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:49.600714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045f318-f2cb-43c9-92bf-0691a27282f9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.605314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed86ac-f4c0-4464-8bb6-071f052d3d0b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.640403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.642127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.642646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.643103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.643357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.644307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.644752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.645100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.653832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.655149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.656517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.658349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:49.672195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:49.673334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 340/674] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:49.674339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:49.679764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:49.680790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:49.681897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:49.681897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:49.681897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:49.681897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:49.681897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 335/675] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:49.682229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.694357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:49.762732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:49.797236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8faa3-0378-423c-a3ab-e18423e276d8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.804725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2443d2-5a7f-441d-8903-098fd9056ba5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.844457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.845139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.845423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.845700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.846507 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:49.846819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.848318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.850474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:49.851846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:49.852355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:49.852884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:49.853838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:49.854388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:49.856597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:49.866060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 336/676] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:49.867103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.872243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 341/677] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:49.873315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:49.935998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:49.977659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e09a-98db-4527-ae05-0ac2ab2a5928 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:49.992156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109643-4dbc-483c-9d81-8472842baf30 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:50.018128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:50.018514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:50.018794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:50.019100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:50.019850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:50.020138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:50.021547 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:50.022956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:50.031411 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:50.032341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:50.032799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:50.033369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:50.034384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=fc8b95ffc2324085bc736a6fa10f73f8) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:50.034869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:50.036522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:50.036899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 337/678] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:50.037770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:50.044344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 342/679] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:49 2022] GET /identity/v3/role_assignments?user.id=fc8b95ffc2324085bc736a6fa10f73f8&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:50.045392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:50.152060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3e5b3-f870-49d8-ad08-5f9e360554c8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:50.159887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0ac67-05de-466f-985f-e0af527f70e5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:50.181951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:50.191749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:50.192401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:50.193047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:50.193436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:50.201475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:50.201881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:50.202722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:50.203179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:50.203597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:50.203737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:50.213716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:50.215515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:50.220043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:50.221203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:50.222154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:50.222154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:50.222154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:50.222154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:50.222154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:50.222154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:50.222154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:50.222154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:50.227280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 338/680] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:50.229284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:50.242619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:50.243669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:15:50.245074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:50.247733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 343/681] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:50.253292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:50.332518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:50.350678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032286fe-0517-4463-9fe6-6d3bf4303a66 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:50.392173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:50.392870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:50.393147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:50.393475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:50.394268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:50.394606 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:50.396183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:50.400302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ca415-34e5-45d9-83a9-ca292e9ec9f3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:50.411849 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 339/682] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:50.417813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:50.446947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:50.448634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:50.449283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:50.449882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:50.451228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:50.452178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:50.454389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:50.477995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 344/683] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jul 20 15:15:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:50.483493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:50.485396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:50.592405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68e9fa-de8f-4ae4-a16e-6da3c3aef6ef None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:50.603357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:50.636587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b72e-b85b-4fb6-9336-d8e98e461b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:50.639278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b72e-b85b-4fb6-9336-d8e98e461b0c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:50.640941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b72e-b85b-4fb6-9336-d8e98e461b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:50.641416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b72e-b85b-4fb6-9336-d8e98e461b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:50.648627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f130e-b14c-41aa-9ea3-9899423b10da None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:50.711910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:50.712996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:50.713473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:50.713963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:50.715041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=3894e1d2983e4040a4b0ae92ce794f89) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:50.715623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:50.717723 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:50.724918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 340/684] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:50 2022] GET /identity/v3/role_assignments?user.id=3894e1d2983e4040a4b0ae92ce794f89&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:50.769735 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8b72e-b85b-4fb6-9336-d8e98e461b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:50.771250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8b72e-b85b-4fb6-9336-d8e98e461b0c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:50.887026 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 345/685] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:50.892304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:51.024380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbac64-bd39-45ec-99b3-1d5fc53c360b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:51.039504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:51.063852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:51.064727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:51.065009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:51.065504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:51.080157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:51.081626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:51.098856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca67b0-0003-49b0-8186-4d2ce85c502d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:51.099491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:51.100424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:51.101331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:51.101331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:51.101331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:51.101331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:51.101331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 341/686] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:51.102245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca67b0-0003-49b0-8186-4d2ce85c502d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:51.102609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca67b0-0003-49b0-8186-4d2ce85c502d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:51.105345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 346/687] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:51.106466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:51.109754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e116464-9a57-4c70-9dc7-fa0d8199a455 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:51.110044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e116464-9a57-4c70-9dc7-fa0d8199a455 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:51.110321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e116464-9a57-4c70-9dc7-fa0d8199a455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:51.132038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1e116464-9a57-4c70-9dc7-fa0d8199a455 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:51.133271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1e116464-9a57-4c70-9dc7-fa0d8199a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:51.135492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:51.210594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 347/688] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:51.231234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b344d-50b7-427e-a75e-c10db4e514d6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:51.254562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e116464-9a57-4c70-9dc7-fa0d8199a455 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:51.277637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:51.278322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:51.278601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:51.278871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:51.279652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:51.279957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:51.281341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:51.311853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 342/689] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:51.314456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:51.362468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:51.456330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e116464-9a57-4c70-9dc7-fa0d8199a455 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:51.502344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4db00-05b4-4dc8-80f5-9336437a123c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:51.530772 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9e518-0963-46b1-9a87-4497b413ca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:51.531616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e518-0963-46b1-9a87-4497b413ca24 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:51.531895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e518-0963-46b1-9a87-4497b413ca24 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:51.532166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9e518-0963-46b1-9a87-4497b413ca24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:51.546473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:51.552610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9e518-0963-46b1-9a87-4497b413ca24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:51.559950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:51.560768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:51.561045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:51.561317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-33d9e518-0963-46b1-9a87-4497b413ca24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:51.567036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:51.567991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:51.568837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:51.569523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 348/690] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:51.574052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:51.575996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9e518-0963-46b1-9a87-4497b413ca24 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:51.577142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:51.601454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:51.603576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:51.605690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 343/691] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:51.609976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:51.764518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:51.781913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9e518-0963-46b1-9a87-4497b413ca24 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:51.798865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af1db-1890-45b2-94d9-cc7844ae1722 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:51.851389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:51.852078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:51.852351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:51.852624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:51.853380 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:51.853688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:51.855134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:51.865981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:51.866654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:51.866933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:51.867227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:51.868027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:51.868335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:51.870139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:51.874711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 349/692] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:51.880542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:51.897746 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 344/693] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:51.904354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:51.991333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:52.035636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19060a-8a35-49ef-9da3-ffb1c5a785ec None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.042396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4aba-e0ab-4aea-b767-7036e388bfa0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.072506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:52.073358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.073724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.073998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.078946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733067a1-861c-47a4-98e7-c3e345801f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:52.079917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733067a1-861c-47a4-98e7-c3e345801f61 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.080394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733067a1-861c-47a4-98e7-c3e345801f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.080912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733067a1-861c-47a4-98e7-c3e345801f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.081942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733067a1-861c-47a4-98e7-c3e345801f61 None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=8db8ce1a1d9143c491304d0b72ace736) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:52.082472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733067a1-861c-47a4-98e7-c3e345801f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:52.084220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733067a1-861c-47a4-98e7-c3e345801f61 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:52.084971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:52.086597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:52.091788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 345/694] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:51 2022] GET /identity/v3/role_assignments?user.id=8db8ce1a1d9143c491304d0b72ace736&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:52.093530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e330-2bb7-44e7-9bd2-7f82be0c61a5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.094018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e330-2bb7-44e7-9bd2-7f82be0c61a5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.094487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e330-2bb7-44e7-9bd2-7f82be0c61a5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.096370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 346/695] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:52.103075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f43bbd-9c7d-4aee-bb48-0cb5dc44f946 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.103940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f43bbd-9c7d-4aee-bb48-0cb5dc44f946 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.104439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f43bbd-9c7d-4aee-bb48-0cb5dc44f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:52.114802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:52.115890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:52.116773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:52.116773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:52.116773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:52.116773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:52.116773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 350/696] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:52.122684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:52.128879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e2f43bbd-9c7d-4aee-bb48-0cb5dc44f946 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:52.130204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e2f43bbd-9c7d-4aee-bb48-0cb5dc44f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:52.132642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:52.227459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 347/697] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:52.257113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f43bbd-9c7d-4aee-bb48-0cb5dc44f946 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:52.320639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28571a-d928-45a8-ab04-f5d1e68a7267 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.336953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:52.363789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:52.364728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.365017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.366218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.367289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:52.367612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:52.369035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:52.385499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 351/698] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:52.389294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f43bbd-9c7d-4aee-bb48-0cb5dc44f946 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.391633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:52.433938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:52.435200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.435656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.436878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.445049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:52.451589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:52.453533 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:52.477778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:52.478921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:52.480078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:52.480078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:52.480078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:52.480078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:52.482024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 348/699] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:52.488796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:52.517475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e0ee9-20ff-4bcb-ba9b-9503d0862a3d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.566622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2af73-b9b5-4f68-8c57-13fea3d08eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:52.567753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2af73-b9b5-4f68-8c57-13fea3d08eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.568185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2af73-b9b5-4f68-8c57-13fea3d08eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.568604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2af73-b9b5-4f68-8c57-13fea3d08eb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.580259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2af73-b9b5-4f68-8c57-13fea3d08eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:52.581987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2af73-b9b5-4f68-8c57-13fea3d08eb5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-34e2af73-b9b5-4f68-8c57-13fea3d08eb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:52.599444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:52.600675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:52.601848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 352/700] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:15:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:52.602526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f8a0-4dc2-48fc-a028-dbaca77d10a1 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.602618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f8a0-4dc2-48fc-a028-dbaca77d10a1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.602826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f8a0-4dc2-48fc-a028-dbaca77d10a1 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.604320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 353/701] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:52.605263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23d2f3-8ec8-4b69-8b9a-410072a539ed None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.607387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78f8a0-4dc2-48fc-a028-dbaca77d10a1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:52.650387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:52.651065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777629a-ca97-4e02-8379-a4fdc2aa3c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:52.651939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777629a-ca97-4e02-8379-a4fdc2aa3c2f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.652288 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777629a-ca97-4e02-8379-a4fdc2aa3c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.652792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777629a-ca97-4e02-8379-a4fdc2aa3c2f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.653658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777629a-ca97-4e02-8379-a4fdc2aa3c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:52.654122 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777629a-ca97-4e02-8379-a4fdc2aa3c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:52.655844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777629a-ca97-4e02-8379-a4fdc2aa3c2f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:52.671561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 349/702] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:52.676836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a4f7-3e23-465a-a7f0-68b24297c646 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.676836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a4f7-3e23-465a-a7f0-68b24297c646 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.676836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5a4f7-3e23-465a-a7f0-68b24297c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.702898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0cc5a4f7-3e23-465a-a7f0-68b24297c646 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:52.704479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0cc5a4f7-3e23-465a-a7f0-68b24297c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:52.733154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78f8a0-4dc2-48fc-a028-dbaca77d10a1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.766143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:52.778129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:52.779409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.780280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.781017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.782319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:52.783372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:52.784884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:52.802996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 350/703] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:52.802996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5a4f7-3e23-465a-a7f0-68b24297c646 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:52.818345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 354/704] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:15:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:52.823774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:52.917974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5a4f7-3e23-465a-a7f0-68b24297c646 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.938126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:52.957206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a686971-1bc2-4a4e-8329-77e9c6a512a6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:52.968315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767fb3f-665a-439c-8923-7f85f34db9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:52.969777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fb3f-665a-439c-8923-7f85f34db9da None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:52.970547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fb3f-665a-439c-8923-7f85f34db9da None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:52.971063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fb3f-665a-439c-8923-7f85f34db9da None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:52.972243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767fb3f-665a-439c-8923-7f85f34db9da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:52.974698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767fb3f-665a-439c-8923-7f85f34db9da None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:53.000315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f2d13-2fc2-4b35-a71e-b75e87ebb5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:53.001458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f2d13-2fc2-4b35-a71e-b75e87ebb5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.001947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f2d13-2fc2-4b35-a71e-b75e87ebb5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.002532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f2d13-2fc2-4b35-a71e-b75e87ebb5f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.007435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 351/705] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:15:52 2022] POST /identity/v3/users => generated 254 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:53.008415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767fb3f-665a-439c-8923-7f85f34db9da None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:53.101061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f2d13-2fc2-4b35-a71e-b75e87ebb5f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:53.103488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f2d13-2fc2-4b35-a71e-b75e87ebb5f7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:53.133539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:53.252282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767fb3f-665a-439c-8923-7f85f34db9da None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:53.254181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:53.271903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 355/706] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:53.273531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f2d13-2fc2-4b35-a71e-b75e87ebb5f7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:53.299506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f665e2-6dad-4fd4-95b3-00d09a23db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:53.300329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f665e2-6dad-4fd4-95b3-00d09a23db70 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.300597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f665e2-6dad-4fd4-95b3-00d09a23db70 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.300858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f665e2-6dad-4fd4-95b3-00d09a23db70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.301512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f665e2-6dad-4fd4-95b3-00d09a23db70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:53.302899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f665e2-6dad-4fd4-95b3-00d09a23db70 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a9f665e2-6dad-4fd4-95b3-00d09a23db70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:53.317954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:53.319107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:53.320189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 352/707] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Jul 20 15:15:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:53.322322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab708-4ddc-4acc-b23e-88f2f8822d82 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.322322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab708-4ddc-4acc-b23e-88f2f8822d82 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.322322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ab708-4ddc-4acc-b23e-88f2f8822d82 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.323547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 353/708] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:53.327916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ab708-4ddc-4acc-b23e-88f2f8822d82 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:53.407102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f2d13-2fc2-4b35-a71e-b75e87ebb5f7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:53.441335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f5eb-2223-462d-9be1-2dd96f670fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:53.442135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f5eb-2223-462d-9be1-2dd96f670fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.442412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f5eb-2223-462d-9be1-2dd96f670fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.442680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f5eb-2223-462d-9be1-2dd96f670fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.443143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:53.448532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ab708-4ddc-4acc-b23e-88f2f8822d82 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:53.457668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51f5eb-2223-462d-9be1-2dd96f670fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:53.459265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51f5eb-2223-462d-9be1-2dd96f670fd2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bd51f5eb-2223-462d-9be1-2dd96f670fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:53.477791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:53.478839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:53.480057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:53.480057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:53.480057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:53.480057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:53.480057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 356/709] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:53.486295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782d58-d57b-4494-87a6-f8cf89dff89c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.486641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782d58-d57b-4494-87a6-f8cf89dff89c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.487007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782d58-d57b-4494-87a6-f8cf89dff89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.490196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:53.491292 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.491757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.492415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.494175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:53.495091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:53.496687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:53.502839 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 354/710] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jul 20 15:15:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:53.503895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:53.509128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d4782d58-d57b-4494-87a6-f8cf89dff89c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:53.510687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d4782d58-d57b-4494-87a6-f8cf89dff89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:53.549879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:53.585159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 357/711] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:53.586485 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782d58-d57b-4494-87a6-f8cf89dff89c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:53.636369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38d43b-20e5-41be-8938-77ecb630a2ca None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:53.684906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:53.685904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.686367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.686843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.688313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:53.688820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:53.690894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:53.700352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782d58-d57b-4494-87a6-f8cf89dff89c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:53.712416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 355/712] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:53.713628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:53.748187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:53.750259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:53.751348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.752151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.752676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.753981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:53.754820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:53.757526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:53.765231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 358/713] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jul 20 15:15:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:53.766335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:53.813766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:53.899657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bced2-e1d1-468b-b6d0-7736eaa764ab None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:53.902175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131959e-6af9-4db6-a570-c8776ee01983 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:53.950959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:53.952038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:53.952992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:53.953418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:53.962229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:53.964370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:53.982166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:53.983141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:53.984142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:53.984142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:53.984142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:53.984142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:53.984142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:53.984142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:53.984142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:53.984142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:53.986991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 359/714] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:53.995356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:54.007768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:54.008512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:54.008787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:54.009053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:54.009810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:54.011229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:54.032097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:54.033186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:54.034730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 356/715] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:53 2022] GET /identity/v3/services/network => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:54.040176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:54.129614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:54.142990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29926f-201e-48cf-b3ca-632ea8acc087 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:54.184018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:54.203424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f4adf-7f45-4797-b885-b5651b3f83a0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:54.206389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:54.207093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:54.207377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:54.207649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:54.208453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:54.208762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:54.211133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:54.232692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 360/716] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:54.237210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:54.274188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:54.274871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:54.275191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:54.275513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:54.276294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] RBAC: Adding query filter params (name=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:54.276603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:54.278116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:54.287371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 357/717] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:15:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:54.291687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:54.419903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a47db-9a31-46b6-b79b-3f03d594453c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:54.473702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0fdcd-7410-4199-b1f9-63923c15e273 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:54.483955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3fb96-0841-4170-99fa-ce4894dff1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:54.484640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fb96-0841-4170-99fa-ce4894dff1fd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:54.484971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fb96-0841-4170-99fa-ce4894dff1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:54.485249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fb96-0841-4170-99fa-ce4894dff1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:54.486098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3fb96-0841-4170-99fa-ce4894dff1fd None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=29c52f8ffcc34046ac3ade9723bf8b89) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:54.486409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3fb96-0841-4170-99fa-ce4894dff1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:54.487934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3fb96-0841-4170-99fa-ce4894dff1fd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:54.499589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 361/718] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:54 2022] GET /identity/v3/role_assignments?user.id=29c52f8ffcc34046ac3ade9723bf8b89&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:54.525492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cbcb6-c4a3-405b-b606-eb94041514d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:54.526567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbcb6-c4a3-405b-b606-eb94041514d5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:54.527085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbcb6-c4a3-405b-b606-eb94041514d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:54.527599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cbcb6-c4a3-405b-b606-eb94041514d5 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:54.528573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cbcb6-c4a3-405b-b606-eb94041514d5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:54.529199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cbcb6-c4a3-405b-b606-eb94041514d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:54.530889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cbcb6-c4a3-405b-b606-eb94041514d5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:54.546749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 358/719] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:15:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:54.641591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94f65-c2f7-4474-943f-a2135f42fa55 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:54.641917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94f65-c2f7-4474-943f-a2135f42fa55 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:54.642493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f94f65-c2f7-4474-943f-a2135f42fa55 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:54.643907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 362/720] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:54.650216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91916e73-4402-4569-924c-dad853a10241 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:54.650541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91916e73-4402-4569-924c-dad853a10241 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:54.650781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91916e73-4402-4569-924c-dad853a10241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:54.670938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-91916e73-4402-4569-924c-dad853a10241 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:54.672202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-91916e73-4402-4569-924c-dad853a10241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:54.684406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:54.746232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 359/721] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:54.772512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94f65-c2f7-4474-943f-a2135f42fa55 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:54.798436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:54.883591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f94f65-c2f7-4474-943f-a2135f42fa55 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:54.924300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05abbf-8a71-49a8-a3cf-52fa5e40645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:54.925155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05abbf-8a71-49a8-a3cf-52fa5e40645c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:54.925436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05abbf-8a71-49a8-a3cf-52fa5e40645c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:54.925702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05abbf-8a71-49a8-a3cf-52fa5e40645c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:54.936640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05abbf-8a71-49a8-a3cf-52fa5e40645c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-af05abbf-8a71-49a8-a3cf-52fa5e40645c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:54.951034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:54.952557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:54.953376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 363/722] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:54.955456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91916e73-4402-4569-924c-dad853a10241 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:55.095783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91916e73-4402-4569-924c-dad853a10241 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:55.148012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:55.148691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:55.148976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:55.149250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:55.150038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:55.150308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:55.151738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:55.160618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 360/723] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:55.165849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05abbf-8a71-49a8-a3cf-52fa5e40645c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:55.276347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:55.290866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05abbf-8a71-49a8-a3cf-52fa5e40645c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:55.329111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9823b4c-315a-434a-a6d0-4ea1fd426427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:55.329925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823b4c-315a-434a-a6d0-4ea1fd426427 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:55.330211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823b4c-315a-434a-a6d0-4ea1fd426427 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:55.330480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823b4c-315a-434a-a6d0-4ea1fd426427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:55.341435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823b4c-315a-434a-a6d0-4ea1fd426427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:55.342927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823b4c-315a-434a-a6d0-4ea1fd426427 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c9823b4c-315a-434a-a6d0-4ea1fd426427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:55.360803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:55.361694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:55.362657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:55.362657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:55.362657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:55.362657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:55.362657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 364/724] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:55.372095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:55.386400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:55.387730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3ddf-8460-4f74-902c-c2d0d6cf98d5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:55.388066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3ddf-8460-4f74-902c-c2d0d6cf98d5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:55.388475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3ddf-8460-4f74-902c-c2d0d6cf98d5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:55.389669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 365/725] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:55.395171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d64a7-33aa-4f22-8821-f1dfc4c20993 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:55.395456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d64a7-33aa-4f22-8821-f1dfc4c20993 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:55.395787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d64a7-33aa-4f22-8821-f1dfc4c20993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:55.418399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-404d64a7-33aa-4f22-8821-f1dfc4c20993 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:55.419612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-404d64a7-33aa-4f22-8821-f1dfc4c20993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:55.524389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 366/726] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:55.536289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f0c39-5a9c-4e51-9dbf-06b2c98bc3d5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:55.572037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d64a7-33aa-4f22-8821-f1dfc4c20993 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:55.598708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:55.602226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:55.602671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:55.603139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:55.604005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:55.604643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:55.607051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:55.628658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 361/727] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:55.636651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:55.690464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:55.725524 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:55.758663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d64a7-33aa-4f22-8821-f1dfc4c20993 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:55.783745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aa12d-c9b0-4dde-b9fc-9bdf9411d130 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:55.818585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a86c9-4755-46d9-8597-c4f5115274f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:55.819449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a86c9-4755-46d9-8597-c4f5115274f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:55.819726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a86c9-4755-46d9-8597-c4f5115274f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:55.820000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a86c9-4755-46d9-8597-c4f5115274f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:55.837029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a86c9-4755-46d9-8597-c4f5115274f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-de2a86c9-4755-46d9-8597-c4f5115274f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:55.845022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:55.846660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:55.848321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 367/728] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:55.860086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:55.860086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:55.860675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a86c9-4755-46d9-8597-c4f5115274f5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:55.860907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:55.860907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:55.883925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:55.885335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:55.919661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:55.921458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:15:55.923963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:55.927209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 362/729] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:55.928069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:56.071714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a86c9-4755-46d9-8597-c4f5115274f5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:56.151048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:56.174234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:56.174924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:56.175232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:56.175511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:56.176273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:56.176580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:56.177993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:56.190817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6b7b9-de8c-4eb3-ab6d-8b727390e6f6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:56.201622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 368/730] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:56.208273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:56.242492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:56.255993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:56.256744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:56.257026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:56.257299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:56.258152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:56.258461 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:56.259940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:56.285766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 363/731] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jul 20 15:15:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:56.291419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:56.397337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d2d42-a39a-4d9d-987f-199f595b780e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:56.457567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:56.458385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:56.458667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:56.458938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:56.464160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a762-672b-414f-bd06-2ef65e18b67b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:56.482163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:56.483704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:56.512626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:56.513581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:56.514478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:56.514478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:56.514478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:56.514478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:56.514478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 369/732] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:56.521825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:56.541092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d9b46-50fd-4064-ac22-175993331c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:56.541822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d9b46-50fd-4064-ac22-175993331c21 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:56.542106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d9b46-50fd-4064-ac22-175993331c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:56.542422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d9b46-50fd-4064-ac22-175993331c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:56.562178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:56.610325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:56.630010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d9b46-50fd-4064-ac22-175993331c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:56.632735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d9b46-50fd-4064-ac22-175993331c21 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:56.637182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4760ac-b234-401c-8f89-6e6b434b57a5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:56.674390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2afa1-87f1-4266-94ca-ca66eeb4ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:56.675091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2afa1-87f1-4266-94ca-ca66eeb4ac1d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:56.675401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2afa1-87f1-4266-94ca-ca66eeb4ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:56.675656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2afa1-87f1-4266-94ca-ca66eeb4ac1d None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:56.676388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2afa1-87f1-4266-94ca-ca66eeb4ac1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:56.676755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2afa1-87f1-4266-94ca-ca66eeb4ac1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:56.678314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2afa1-87f1-4266-94ca-ca66eeb4ac1d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:56.695062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 370/733] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:56.695062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8eec4-5651-4ed2-9b55-d359ed5eca55 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:56.695062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8eec4-5651-4ed2-9b55-d359ed5eca55 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:56.695062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8eec4-5651-4ed2-9b55-d359ed5eca55 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:56.695062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 371/734] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:56.696986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8eec4-5651-4ed2-9b55-d359ed5eca55 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:56.762359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 364/735] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:56.763807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667715-76f0-4b5d-8c07-ed7355cc420b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:56.764379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667715-76f0-4b5d-8c07-ed7355cc420b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:56.764379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667715-76f0-4b5d-8c07-ed7355cc420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:56.782665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-38667715-76f0-4b5d-8c07-ed7355cc420b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:56.783911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-38667715-76f0-4b5d-8c07-ed7355cc420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:56.803745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:56.811954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8eec4-5651-4ed2-9b55-d359ed5eca55 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:56.852801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:56.853543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 365/736] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:56.854282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:56.854470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38667715-76f0-4b5d-8c07-ed7355cc420b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:56.854925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:56.855602 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:56.864126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:56.866159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:56.872905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:56.887271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:56.888230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:15:56.889178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:56.891936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 372/737] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:15:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:56.897197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:56.968986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38667715-76f0-4b5d-8c07-ed7355cc420b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.004969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.005789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.006138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.006423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.015316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69b783-f1d7-444d-aeee-6ca40352c69d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.017019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.018792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:57.042046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:57.043060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:57.043958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:57.043958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:57.043958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:57.043958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:57.043958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 366/738] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:57.051033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.059488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed98a1c-bc88-46b8-b19e-df746121680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.060200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98a1c-bc88-46b8-b19e-df746121680a None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.060562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98a1c-bc88-46b8-b19e-df746121680a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.060792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98a1c-bc88-46b8-b19e-df746121680a None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.061626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed98a1c-bc88-46b8-b19e-df746121680a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.063072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed98a1c-bc88-46b8-b19e-df746121680a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:57.078892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 373/739] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:15:56 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:57.080278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e3a6-1b16-4324-b462-6f2e139154d5 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.080571 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e3a6-1b16-4324-b462-6f2e139154d5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.080854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e3a6-1b16-4324-b462-6f2e139154d5 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.082106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 374/740] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:57.082836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e3a6-1b16-4324-b462-6f2e139154d5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.110603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:57.142690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:57.182642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453406-4ae7-4bf8-99f7-0cea5283c47b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.221558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e3a6-1b16-4324-b462-6f2e139154d5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.231146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550f4fe-ceb7-4592-8989-f2e156facd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.231989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f4fe-ceb7-4592-8989-f2e156facd8b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.232366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f4fe-ceb7-4592-8989-f2e156facd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.232741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f4fe-ceb7-4592-8989-f2e156facd8b None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.233683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550f4fe-ceb7-4592-8989-f2e156facd8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:57.234279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550f4fe-ceb7-4592-8989-f2e156facd8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.235645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550f4fe-ceb7-4592-8989-f2e156facd8b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:57.254645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 367/741] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jul 20 15:15:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:57.255978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5cb2d-5447-49c8-a3ea-e5893fea9156 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.256296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5cb2d-5447-49c8-a3ea-e5893fea9156 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.256658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5cb2d-5447-49c8-a3ea-e5893fea9156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.262104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7236e1-0747-4378-906f-5f496f208407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.263141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7236e1-0747-4378-906f-5f496f208407 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.263572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7236e1-0747-4378-906f-5f496f208407 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.264028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7236e1-0747-4378-906f-5f496f208407 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.264773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7236e1-0747-4378-906f-5f496f208407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:57.265080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7236e1-0747-4378-906f-5f496f208407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.266548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7236e1-0747-4378-906f-5f496f208407 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:57.273403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7de5cb2d-5447-49c8-a3ea-e5893fea9156 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:57.274597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7de5cb2d-5447-49c8-a3ea-e5893fea9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:57.280456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 375/742] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:57.281787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200e66-ea84-4d64-be5d-c28cbb7bcd03 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.282077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200e66-ea84-4d64-be5d-c28cbb7bcd03 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.282338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200e66-ea84-4d64-be5d-c28cbb7bcd03 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.283610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 376/743] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:57.284299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56200e66-ea84-4d64-be5d-c28cbb7bcd03 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.343249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 368/744] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:57.344143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5cb2d-5447-49c8-a3ea-e5893fea9156 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.373927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:57.407760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:57.408806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56200e66-ea84-4d64-be5d-c28cbb7bcd03 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.446387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f738b5-3104-4936-82a5-a01298606cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.447238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f738b5-3104-4936-82a5-a01298606cad None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.447613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f738b5-3104-4936-82a5-a01298606cad None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.447988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f738b5-3104-4936-82a5-a01298606cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.457801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5cb2d-5447-49c8-a3ea-e5893fea9156 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.493420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39264159-3d81-41c4-8f73-e3cff79ddcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.494230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39264159-3d81-41c4-8f73-e3cff79ddcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.494511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39264159-3d81-41c4-8f73-e3cff79ddcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.495172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39264159-3d81-41c4-8f73-e3cff79ddcc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.501998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39264159-3d81-41c4-8f73-e3cff79ddcc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.503491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39264159-3d81-41c4-8f73-e3cff79ddcc4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-39264159-3d81-41c4-8f73-e3cff79ddcc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:57.517617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:57.518663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:57.519802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:57.519802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:57.519802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:57.519802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:57.519802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:57.519802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:57.519802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:57.519802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:57.523874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f738b5-3104-4936-82a5-a01298606cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.524639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 369/745] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:57.525357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f738b5-3104-4936-82a5-a01298606cad None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:57.525749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a706a-b8cc-4c67-a927-20cffb977cd2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.526039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a706a-b8cc-4c67-a927-20cffb977cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.526316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a706a-b8cc-4c67-a927-20cffb977cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.542589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a06a706a-b8cc-4c67-a927-20cffb977cd2 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:57.543813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a06a706a-b8cc-4c67-a927-20cffb977cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:57.596686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:57.616226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 370/746] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:15:57.617082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a706a-b8cc-4c67-a927-20cffb977cd2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.640551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 377/747] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:57 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:15:57.641836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f738b5-3104-4936-82a5-a01298606cad None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.678878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:57.737447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a706a-b8cc-4c67-a927-20cffb977cd2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.760017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f738b5-3104-4936-82a5-a01298606cad None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.774313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53767de7-9d09-4081-9874-fad828af636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.775096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53767de7-9d09-4081-9874-fad828af636f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.775356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53767de7-9d09-4081-9874-fad828af636f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.775624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53767de7-9d09-4081-9874-fad828af636f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.786217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53767de7-9d09-4081-9874-fad828af636f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-53767de7-9d09-4081-9874-fad828af636f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:57.794078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:57.795023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:57.795871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 371/748] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:57.796549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53767de7-9d09-4081-9874-fad828af636f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.801759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc400046-171f-43a1-b829-037238b8865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.802472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400046-171f-43a1-b829-037238b8865b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.802755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400046-171f-43a1-b829-037238b8865b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.803062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400046-171f-43a1-b829-037238b8865b None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.803900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc400046-171f-43a1-b829-037238b8865b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:57.804207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc400046-171f-43a1-b829-037238b8865b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.805664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc400046-171f-43a1-b829-037238b8865b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:57.822940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 378/749] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:57.822940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc400046-171f-43a1-b829-037238b8865b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.855911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:57.906549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53767de7-9d09-4081-9874-fad828af636f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.908096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:57.929198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc400046-171f-43a1-b829-037238b8865b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:57.951643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bdcd-f8ec-44a0-b810-9c8af58d4449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.952488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bdcd-f8ec-44a0-b810-9c8af58d4449 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.952778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bdcd-f8ec-44a0-b810-9c8af58d4449 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.953050 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bdcd-f8ec-44a0-b810-9c8af58d4449 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.953782 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756bdcd-f8ec-44a0-b810-9c8af58d4449 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.955208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756bdcd-f8ec-44a0-b810-9c8af58d4449 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:57.968878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:57.969687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:57.969971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:57.970242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:57.979436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 372/750] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:15:57 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:57.981658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bdcd-f8ec-44a0-b810-9c8af58d4449 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:57.982860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:57.984400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:58.006599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:58.007793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:58.008671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:58.008671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:58.008671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:58.008671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:58.012948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 379/751] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:58.013935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:58.115765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:58.135674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f495c3-5d8f-40d8-b919-e7849425c034 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:58.142859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bdcd-f8ec-44a0-b810-9c8af58d4449 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:58.177646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:58.178377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:58.178659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:58.178932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:58.179799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=8db8ce1a1d9143c491304d0b72ace736) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:58.180106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:58.181630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.185580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:58.186285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:58.186541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:58.186810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:58.187609 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:58.187910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:58.188499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 380/752] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/role_assignments?user.id=8db8ce1a1d9143c491304d0b72ace736&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:58.189285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.189391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:58.201560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 373/753] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:58.213152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:58.247341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:58.327671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e1734-b50b-4429-90b2-e32f3479f64d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:58.351283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985f21a-1ab2-46f2-a286-b561e4a0433e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:58.367969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:58.369188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:58.369988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:58.370408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:58.371684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:58.372584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:58.374365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.391285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:58.392378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:58.392537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 381/754] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:58.395010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:58.395010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:58.398698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:58.408243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:58.410107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.420718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:58.435062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:58.435995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:58.436873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:58.436873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:58.436873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:58.436873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:58.443106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 374/755] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:58.445148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:58.537952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692c7a-bc9f-4d9d-84e4-e7674302a31c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:58.547603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:58.567356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225311-db2e-4090-bb4b-1cf0d07f2523 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:58.595441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:58.596263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:58.596539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:58.596805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:58.606637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:58.607665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:58.608164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:58.608626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:58.609552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:58.610056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:58.611783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.616003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:58.617489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.626912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 375/756] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:58.633059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:58.639824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:58.640791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:58.641680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:58.641680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:58.641680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:58.641680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:58.641680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:58.641680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:58.641680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:58.641680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:58.647424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 382/757] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:58.653176 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:58.751395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152e9ef-8a43-4656-b1e9-a32e58136648 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:58.789300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:58.790472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:58.790944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:58.791544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:58.795152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:58.800604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:58.802449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.824843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:58.830165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:58.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:15:58.832060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:58.834763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 376/758] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:58.849449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:58.868692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ba3ab-962b-467a-9e0a-5744c88b4ee0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:58.907911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:58.908825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:58.909150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:58.909422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:58.910215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:58.910519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:58.912568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:58.947557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 383/759] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:58.956486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:59.053100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63db07b-2442-46a4-8e77-f7e6dfd81311 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:59.120566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:59.121647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:59.122148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:59.122613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:59.123692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:59.124197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:59.126008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:59.144427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a92909-6170-4523-834e-921a18580fa6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:59.163617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 377/760] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:59.170518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:59.188825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:59.198193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2658665-ae60-4d40-97b0-97021e36e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:59.199162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658665-ae60-4d40-97b0-97021e36e605 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:59.199643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658665-ae60-4d40-97b0-97021e36e605 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:59.200158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658665-ae60-4d40-97b0-97021e36e605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:59.201282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2658665-ae60-4d40-97b0-97021e36e605 None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=5cdab500d7854e69b13a16aa5946df6b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:59.201792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2658665-ae60-4d40-97b0-97021e36e605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:59.203711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2658665-ae60-4d40-97b0-97021e36e605 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:59.210022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 384/761] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:58 2022] GET /identity/v3/role_assignments?user.id=5cdab500d7854e69b13a16aa5946df6b&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:59.211559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01543-64e7-43aa-ae91-4a25b3878333 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:59.212061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01543-64e7-43aa-ae91-4a25b3878333 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:59.212558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01543-64e7-43aa-ae91-4a25b3878333 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:59.214516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 385/762] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:59.226575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7c85f-e938-4faa-af70-486e386bec26 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:59.227269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7c85f-e938-4faa-af70-486e386bec26 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:59.227747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7c85f-e938-4faa-af70-486e386bec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:59.229752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:59.252422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0ff7c85f-e938-4faa-af70-486e386bec26 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:59.255056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ff7c85f-e938-4faa-af70-486e386bec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:59.334671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0c079-6420-44e5-b027-fb20ca98d902 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:59.405670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 386/763] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:15:59.408263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:59.409307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:59.409814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:59.410278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:59.421917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:59.423741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:59.429216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7c85f-e938-4faa-af70-486e386bec26 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:59.448735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:59.449686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:59.451061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:59.451061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:59.451061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:59.451061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:15:59.451061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 378/764] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:59.455994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:59.623348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7c85f-e938-4faa-af70-486e386bec26 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:59.642181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f8ddc-1b4f-45de-9729-68811f3a1c4f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:59.644113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:59.671093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:59.695150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:59.696072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:59.696353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:59.696626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:59.697289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:59.698719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:59.713726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:59.714738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:15:59.715784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 387/765] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Jul 20 15:15:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:59.723133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:59.724026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:59.724440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:59.724842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:59.725892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:59.726329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:59.727897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:59.734993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:59.757850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 379/766] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:59.762186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:59.911809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4951-1152-402e-871a-2abdad96ed9c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:59.938286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37726b8-8fdf-4ea6-bd2f-1b7860d9b7b6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:59.965419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:59.966102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:59.966381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:59.966653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:59.967393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:59.967721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:59.969242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:59.976943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 388/767] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jul 20 15:15:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:59.981967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:00.021271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:00.022144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.022421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.022696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.032931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:00.034577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:00.056293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:00.064405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:00.065315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:00.066227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:00.066227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:00.066227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:00.066227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:00.066227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:00.066227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:00.066227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:00.066227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:00.075070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 380/768] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:00.076034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:00.116243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07dfa-30d4-40b3-b39f-f45a6a1877bb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:00.140439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:00.151840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:00.153133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.153421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.153702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.154407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:00.154713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:00.156143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:00.161496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 389/769] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jul 20 15:15:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:00.171930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:00.308092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2b330-7658-4986-af25-c165a7048f38 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:00.311507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463d8a0-6550-435c-9166-fa601e50a418 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:00.337549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:00.377699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95bfae-015b-460d-b739-e1803234a3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:00.378384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95bfae-015b-460d-b739-e1803234a3ce None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.378663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95bfae-015b-460d-b739-e1803234a3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.378933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95bfae-015b-460d-b739-e1803234a3ce None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.380222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95bfae-015b-460d-b739-e1803234a3ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:00.380531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95bfae-015b-460d-b739-e1803234a3ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:00.382031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95bfae-015b-460d-b739-e1803234a3ce None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:00.384841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6bea7-90ab-416e-a527-bd3260de0efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:00.385627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6bea7-90ab-416e-a527-bd3260de0efa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.385973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6bea7-90ab-416e-a527-bd3260de0efa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.386310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6bea7-90ab-416e-a527-bd3260de0efa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.387206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6bea7-90ab-416e-a527-bd3260de0efa None admin] RBAC: Adding query filter params (interface=public, service_id=dacb5ad625044541b125e1821dda21b1, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:00.387587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6bea7-90ab-416e-a527-bd3260de0efa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:00.389038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6bea7-90ab-416e-a527-bd3260de0efa None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:00.397021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 381/770] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:00.398577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28ca25-81de-4ef1-8c77-a3d52d6a3143 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.399053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28ca25-81de-4ef1-8c77-a3d52d6a3143 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.399487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28ca25-81de-4ef1-8c77-a3d52d6a3143 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.401127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 382/771] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:00.402719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28ca25-81de-4ef1-8c77-a3d52d6a3143 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:00.403684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 390/772] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jul 20 15:16:00 2022] GET /identity/v3/endpoints?service_id=dacb5ad625044541b125e1821dda21b1&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:00.411077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a44ac-c416-48c0-a024-6028a9b0a189 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.411077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a44ac-c416-48c0-a024-6028a9b0a189 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.411077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a44ac-c416-48c0-a024-6028a9b0a189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.427640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8f6a44ac-c416-48c0-a024-6028a9b0a189 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:00.429199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8f6a44ac-c416-48c0-a024-6028a9b0a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:00.491423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:00.513897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28ca25-81de-4ef1-8c77-a3d52d6a3143 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:00.514820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 391/773] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:00.515839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a44ac-c416-48c0-a024-6028a9b0a189 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:00.557129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c82a-c752-45d4-9194-f0686c8dca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:00.558400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c82a-c752-45d4-9194-f0686c8dca9e None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.558827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c82a-c752-45d4-9194-f0686c8dca9e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.559299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c82a-c752-45d4-9194-f0686c8dca9e None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/29c52f8ffcc34046ac3ade9723bf8b89/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.564343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3c82a-c752-45d4-9194-f0686c8dca9e None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=29c52f8ffcc34046ac3ade9723bf8b89, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:00.565865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3c82a-c752-45d4-9194-f0686c8dca9e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:00.591282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 383/774] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:16:00 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/29c52f8ffcc34046ac3ade9723bf8b89/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:16:00.591282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c82a-c752-45d4-9194-f0686c8dca9e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:00.711295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a44ac-c416-48c0-a024-6028a9b0a189 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:00.729633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:00.733929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c82a-c752-45d4-9194-f0686c8dca9e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:00.771046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b4e19-c481-4565-819b-c08c63a73c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:00.772231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4e19-c481-4565-819b-c08c63a73c4c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.772746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4e19-c481-4565-819b-c08c63a73c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.773239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b4e19-c481-4565-819b-c08c63a73c4c None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.774136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b4e19-c481-4565-819b-c08c63a73c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:00.775820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b4e19-c481-4565-819b-c08c63a73c4c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:00.780169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:00.781003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.781280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.781550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] PATH_INFO: `/v3/services/network` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.782222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:00.783605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 392/775] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:16:00 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:00.783819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:00.785445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9aa68-6277-4567-ad2c-e501272b93d2 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.785935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9aa68-6277-4567-ad2c-e501272b93d2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.786403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9aa68-6277-4567-ad2c-e501272b93d2 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.792693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 393/776] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:00.794560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d640-d84a-4765-9094-d9251c4ee45a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.795097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d640-d84a-4765-9094-d9251c4ee45a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.795623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d640-d84a-4765-9094-d9251c4ee45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:00.796877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:00.797863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:00.798715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 384/777] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:00 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:00.811138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:00.815845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:00.835138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d240d640-d84a-4765-9094-d9251c4ee45a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:00.836394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d240d640-d84a-4765-9094-d9251c4ee45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:00.912353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 394/778] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:00.927263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5e5d-5342-4888-a8ae-b7a19ece8243 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:00.940049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240d640-d84a-4765-9094-d9251c4ee45a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:00.975521 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:00.976264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:00.976539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:00.976811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:00.977527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:00.977929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:00.979549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:00.985140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 385/779] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:00.990690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:01.083773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:01.087765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240d640-d84a-4765-9094-d9251c4ee45a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:01.089478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:01.119130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e553-df8b-4191-bcca-e7368874d5e2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:01.126035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473584-a170-41b7-bc4a-d67d4497c4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:01.126856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473584-a170-41b7-bc4a-d67d4497c4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.127163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473584-a170-41b7-bc4a-d67d4497c4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.127439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473584-a170-41b7-bc4a-d67d4497c4d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.138335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473584-a170-41b7-bc4a-d67d4497c4d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7c473584-a170-41b7-bc4a-d67d4497c4d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:01.146536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:01.148759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:01.150232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 395/780] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:01.155623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:01.156383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.156668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.156941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.157326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473584-a170-41b7-bc4a-d67d4497c4d9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:01.157826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] RBAC: Adding query filter params (type=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:01.157988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:01.159344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:01.167161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 386/781] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:01.175957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:01.318190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473584-a170-41b7-bc4a-d67d4497c4d9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:01.349138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9cc67-2fce-4890-81b6-94e810be0e2e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:01.385549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:01.386232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.386506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.386779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.387584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:01.387877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:01.389293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:01.401286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 396/782] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:01.406739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:01.422394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:01.423218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.423494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.423763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.424734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] RBAC: Adding query filter params (interface=public, service_id=052bdac537ad4440a7b67721b88a3191, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:01.425042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:01.427115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:01.429917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:01.442410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 387/783] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jul 20 15:16:01 2022] GET /identity/v3/endpoints?service_id=052bdac537ad4440a7b67721b88a3191&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:01.442614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:01.446613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:01.570578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518d7c5-abf5-4bdf-baa1-0c91699daee1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:01.603029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc78c36-93cc-459d-8a90-0dbed81890fc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:01.614306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc001854-93ba-4b2a-9059-0bf805fb7e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:01.614998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001854-93ba-4b2a-9059-0bf805fb7e9b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.615287 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001854-93ba-4b2a-9059-0bf805fb7e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.615588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc001854-93ba-4b2a-9059-0bf805fb7e9b None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.616280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001854-93ba-4b2a-9059-0bf805fb7e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:01.617664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc001854-93ba-4b2a-9059-0bf805fb7e9b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:01.625080 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 388/784] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:16:01 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:01.626822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46752c-e16d-4b73-a07d-831bb4cebbc7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.627150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46752c-e16d-4b73-a07d-831bb4cebbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.627429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46752c-e16d-4b73-a07d-831bb4cebbc7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.631084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 389/785] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:01.636427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1035-94af-49e9-9120-8843b12f93f1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.636696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1035-94af-49e9-9120-8843b12f93f1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.636978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1035-94af-49e9-9120-8843b12f93f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.657788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:01.658747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-862d1035-94af-49e9-9120-8843b12f93f1 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:01.659293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.659788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.660059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-862d1035-94af-49e9-9120-8843b12f93f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:01.660464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.676556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:01.679055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:01.699990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:01.700959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:01.701848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:01.701848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:01.701848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:01.701848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:01.704255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 397/786] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:01.712219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:01.722218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:01.774993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 390/787] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:01.833839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:01.834173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d1035-94af-49e9-9120-8843b12f93f1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:01.860719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaed911-5f3d-46d7-83fe-4cd1905be585 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:01.900209 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:01.900983 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:01.901270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:01.901534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:01.902398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:01.902708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:01.904347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:01.918398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 398/788] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:01.924270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:01.987145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d1035-94af-49e9-9120-8843b12f93f1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.025443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8887d-6302-4d13-a72e-f82e6e0415de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.026405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8887d-6302-4d13-a72e-f82e6e0415de None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.026779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8887d-6302-4d13-a72e-f82e6e0415de None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.027205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8887d-6302-4d13-a72e-f82e6e0415de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.038911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8887d-6302-4d13-a72e-f82e6e0415de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2cb8887d-6302-4d13-a72e-f82e6e0415de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:02.047173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:02.048327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:16:02.049389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:02.051671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 391/789] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:16:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:02.057519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8887d-6302-4d13-a72e-f82e6e0415de None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:02.060997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9171-e9cd-42dc-8569-07ef1014ed1d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.103713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.104711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.105126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.105525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.109210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:02.115015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:02.116819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:02.125762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:02.133113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:02.134374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:16:02.135587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:02.137347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 399/790] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:16:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:02.144738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:02.201442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8887d-6302-4d13-a72e-f82e6e0415de None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.295715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.296475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.296754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.297075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.297417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388c4ec-f48b-4ed1-b536-5169e7bf7c9b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.297873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:02.298307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:02.299753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:02.312229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 392/791] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:16:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:02.317684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:02.345281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.345970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.346251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.346520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.347405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:02.347711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:02.349452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:02.372639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 400/792] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jul 20 15:16:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:02.378368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:02.450197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:02.498896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfa42c-1e1f-4e00-8399-ff902509ad39 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.536618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.537569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.537950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.538226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.549101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:02.550684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:02.552176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365af90-1d34-412d-983f-030d9e0be88c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:02.568974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:02.569886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:02.570796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:02.570796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:02.570796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:02.570796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:02.570796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 401/793] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:02.576233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:02.584097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:02.627821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.628572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.628876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.629131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.649417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:02.650903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:02.678202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e05c7e-2410-4870-a4cf-1935be8443e1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:02.680563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:02.681424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:02.682293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:02.682293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:02.682293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:02.682293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:02.682293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 393/794] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:02.689975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:02.699585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:02.714421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.715146 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.715431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.715704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.716427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:02.716734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:02.718131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:02.742916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 402/795] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:02.748974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:02.898792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b73dfa-57f3-4525-82e4-ed73b231625a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.900896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5e08c-e9ea-4938-b071-c6b8504ad893 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:02.962372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06de51-3fee-47d4-a35d-552e622fe366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.963782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06de51-3fee-47d4-a35d-552e622fe366 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.964679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06de51-3fee-47d4-a35d-552e622fe366 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.965395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06de51-3fee-47d4-a35d-552e622fe366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.969433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36367-accd-47a9-91b8-ac754a87f774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:02.970108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36367-accd-47a9-91b8-ac754a87f774 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.970387 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36367-accd-47a9-91b8-ac754a87f774 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.970662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36367-accd-47a9-91b8-ac754a87f774 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.971429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36367-accd-47a9-91b8-ac754a87f774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:02.971735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36367-accd-47a9-91b8-ac754a87f774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:02.973169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36367-accd-47a9-91b8-ac754a87f774 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:02.974441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06de51-3fee-47d4-a35d-552e622fe366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:02.977029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06de51-3fee-47d4-a35d-552e622fe366 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:02.987257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 394/796] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:02.988603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841fbb-151a-47f5-bc9d-b776998feae3 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:02.988888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841fbb-151a-47f5-bc9d-b776998feae3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:02.989162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841fbb-151a-47f5-bc9d-b776998feae3 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:02.991062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 395/797] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:02.992328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31841fbb-151a-47f5-bc9d-b776998feae3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4d06de51-3fee-47d4-a35d-552e622fe366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:03.001372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:03.002273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:03.003197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:03.003197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:03.003197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:03.003197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:03.003197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:03.003197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:03.003197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:03.003197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:03.007079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 403/798] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:03.008577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c715f-8c7c-40da-bd9b-5425b6a19746 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.010905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c715f-8c7c-40da-bd9b-5425b6a19746 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.011364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c715f-8c7c-40da-bd9b-5425b6a19746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.031505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3a7c715f-8c7c-40da-bd9b-5425b6a19746 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:03.032704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3a7c715f-8c7c-40da-bd9b-5425b6a19746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:03.036213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:03.053995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:03.110240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 404/799] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:03.110240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c715f-8c7c-40da-bd9b-5425b6a19746 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.151860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31841fbb-151a-47f5-bc9d-b776998feae3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:03.198369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:03.200172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.200903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.201353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.212008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:03.214404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:03.215358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c715f-8c7c-40da-bd9b-5425b6a19746 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:03.234625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:03.235825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:03.236881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:03.239939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 396/800] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:16:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:03.240986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.259001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:03.259900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.260277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.260646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.261648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:03.262059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:03.263694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:03.281082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 405/801] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:03.281082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.302269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:03.343322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:03.359932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd11f-dc56-4f62-8972-d94500e616ce None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:03.405639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7d17-3d6e-4505-998c-1a1d2eb51702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:03.406921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7d17-3d6e-4505-998c-1a1d2eb51702 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.407480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7d17-3d6e-4505-998c-1a1d2eb51702 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.407894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7d17-3d6e-4505-998c-1a1d2eb51702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.408381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813fa7e-61ed-4779-b171-20b9d3f4bf12 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:03.422033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d7d17-3d6e-4505-998c-1a1d2eb51702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b08d7d17-3d6e-4505-998c-1a1d2eb51702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:03.430540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:03.431538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:03.432384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 397/802] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:03.433083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7d17-3d6e-4505-998c-1a1d2eb51702 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.451175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a163-1044-441e-80b5-fdf7c84b5dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:03.451966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a163-1044-441e-80b5-fdf7c84b5dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.452243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a163-1044-441e-80b5-fdf7c84b5dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.452515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a163-1044-441e-80b5-fdf7c84b5dc7 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.453354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a163-1044-441e-80b5-fdf7c84b5dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:03.453662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a163-1044-441e-80b5-fdf7c84b5dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:03.455393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a163-1044-441e-80b5-fdf7c84b5dc7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:03.473875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 406/803] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jul 20 15:16:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:03.475371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb584a66-1c09-4798-a8e5-68e733d97c19 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.475657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb584a66-1c09-4798-a8e5-68e733d97c19 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.475935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb584a66-1c09-4798-a8e5-68e733d97c19 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.481166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 407/804] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:03.481166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb584a66-1c09-4798-a8e5-68e733d97c19 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.548923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7d17-3d6e-4505-998c-1a1d2eb51702 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:03.557818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:03.585013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2afd-f718-4c1c-abc1-21db617ee410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:03.585899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2afd-f718-4c1c-abc1-21db617ee410 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.586175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2afd-f718-4c1c-abc1-21db617ee410 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.586734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d2afd-f718-4c1c-abc1-21db617ee410 None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/8db8ce1a1d9143c491304d0b72ace736/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.587374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb584a66-1c09-4798-a8e5-68e733d97c19 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:03.588835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d2afd-f718-4c1c-abc1-21db617ee410 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=8db8ce1a1d9143c491304d0b72ace736, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:03.590619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d2afd-f718-4c1c-abc1-21db617ee410 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:03.604597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 398/805] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:16:03 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/8db8ce1a1d9143c491304d0b72ace736/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:16:03.615344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2afd-f718-4c1c-abc1-21db617ee410 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.623871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:03.645858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80999d-73b4-43be-b98e-09e9a487daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:03.646584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80999d-73b4-43be-b98e-09e9a487daec None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.648081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80999d-73b4-43be-b98e-09e9a487daec None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.649115 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80999d-73b4-43be-b98e-09e9a487daec None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.650000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80999d-73b4-43be-b98e-09e9a487daec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:03.650321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80999d-73b4-43be-b98e-09e9a487daec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:03.652260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80999d-73b4-43be-b98e-09e9a487daec None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:03.664605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 408/806] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:16:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:03.666092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe52a-af58-4120-b253-0f9bc08fd506 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.666380 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe52a-af58-4120-b253-0f9bc08fd506 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.666654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe52a-af58-4120-b253-0f9bc08fd506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.685902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d1ffe52a-af58-4120-b253-0f9bc08fd506 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:03.687491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d1ffe52a-af58-4120-b253-0f9bc08fd506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:03.768275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d2afd-f718-4c1c-abc1-21db617ee410 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:03.775321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 409/807] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:03.776326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffe52a-af58-4120-b253-0f9bc08fd506 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.812975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:03.814189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.814677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.815214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.828623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:03.830120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:03.849131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:03.850185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:03.852071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:03.852071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:03.852071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:03.852071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:03.852071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 399/808] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:03.852071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:03.860807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:03.901522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffe52a-af58-4120-b253-0f9bc08fd506 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:03.923345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:03.950217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:03.950217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:03.950217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:03.950217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:03.967338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:03.969262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:03.989949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:03.991216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:03.992360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:03.992360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:03.992360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:03.992360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:03.994404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 410/809] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:03.995994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.090160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9ca46-d3b6-4e2d-bc40-43860e9f8198 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.116688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d58f-6d49-4efd-a94d-8aae2724904f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.129309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.130353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.130624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.130888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.131669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.133290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.134948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:04.147003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:04.148165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:04.149033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 400/810] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Jul 20 15:16:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:04.149884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.159148 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b73ba1-ca1a-47dc-b8db-c1ecfad05c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.159832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73ba1-ca1a-47dc-b8db-c1ecfad05c32 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.160290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73ba1-ca1a-47dc-b8db-c1ecfad05c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.160573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73ba1-ca1a-47dc-b8db-c1ecfad05c32 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.161304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b73ba1-ca1a-47dc-b8db-c1ecfad05c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:04.161612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b73ba1-ca1a-47dc-b8db-c1ecfad05c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.163092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b73ba1-ca1a-47dc-b8db-c1ecfad05c32 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.180109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 411/811] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:04.180109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a89e-1de7-4537-973b-cbe3578f606b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.180109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a89e-1de7-4537-973b-cbe3578f606b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.180109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a89e-1de7-4537-973b-cbe3578f606b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.180109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 412/812] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:04.181076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699a89e-1de7-4537-973b-cbe3578f606b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.264562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e19016-f789-499c-a1b2-25bd98c9bcce None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.287295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699a89e-1de7-4537-973b-cbe3578f606b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.287696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:04.301400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.302169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.302453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.302728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.303553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:04.303855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.305232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.317377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 401/813] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:04.318185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.328169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f25c1-eb7f-44ca-8b61-427963655cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.328930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f25c1-eb7f-44ca-8b61-427963655cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.329292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f25c1-eb7f-44ca-8b61-427963655cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.329632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f25c1-eb7f-44ca-8b61-427963655cb2 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.330356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f25c1-eb7f-44ca-8b61-427963655cb2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:04.330669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f25c1-eb7f-44ca-8b61-427963655cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.332119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f25c1-eb7f-44ca-8b61-427963655cb2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.341792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 413/814] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:04.341792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b787e-3ddc-4100-85f8-5bb76d2b5a56 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.341792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b787e-3ddc-4100-85f8-5bb76d2b5a56 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.341792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b787e-3ddc-4100-85f8-5bb76d2b5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.356197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-553b787e-3ddc-4100-85f8-5bb76d2b5a56 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:04.357413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-553b787e-3ddc-4100-85f8-5bb76d2b5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:04.395961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:04.439085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 414/815] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:04.439085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b787e-3ddc-4100-85f8-5bb76d2b5a56 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.444838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfd87f-8a0a-4ff4-9d1b-c76dc4c14c20 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.489953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.491063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.491573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.491851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.501722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.503214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:04.522271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:04.523463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 402/816] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:04.529244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.530671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b787e-3ddc-4100-85f8-5bb76d2b5a56 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.569251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.570330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.570608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.570875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.574242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:04.579421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.581317 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:04.599866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:04.600932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:16:04.601857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:04.607591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 415/817] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:04.607591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.633115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f71e0-631d-461b-83fc-4f2d6c07ef35 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.644280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:04.672431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.673391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.673661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.673948 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.674647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:04.674950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.676384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.685861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 403/818] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:04.685861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.727991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6df479-a5c0-4e10-aaf0-c5f1e1790321 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.762750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.763604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.763887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.764167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] PATH_INFO: `/v3/services/network` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.764840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.766312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:04.779137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:04.785401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:04.786522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 416/819] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:04.787625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.806636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae76c7-9af3-42df-8e07-e0db125630e5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.814860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:04.845701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.846386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.846674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.846928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.847755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:04.848254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.849510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.863041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 404/820] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:04.868521 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.885501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:04.892956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16fbf-264f-432f-8d7a-e90916dea22c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:04.929040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:04.929870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:04.930157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:04.930746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:04.931635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:04.931945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:04.933414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:04.950950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 417/821] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:04.951812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:04.983066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cfa9c-fa90-4e9e-9066-3ca6044315db None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:05.019133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df740-3cb5-435d-93ef-cdbdd46861af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:05.019801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df740-3cb5-435d-93ef-cdbdd46861af None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.020081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df740-3cb5-435d-93ef-cdbdd46861af None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.020350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df740-3cb5-435d-93ef-cdbdd46861af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.021090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420df740-3cb5-435d-93ef-cdbdd46861af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:05.022562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420df740-3cb5-435d-93ef-cdbdd46861af None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:05.043846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 405/822] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:16:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:05.044427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df740-3cb5-435d-93ef-cdbdd46861af None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:05.074018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c2a1c-5147-4685-b8f3-48e8f0a8a5e8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:05.087587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:05.128717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:05.129906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.130417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.130899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.131992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] RBAC: Adding query filter params (name=network) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:05.132608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:05.134297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:05.140832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 418/823] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:05.142151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:05.163791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:05.197441 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df740-3cb5-435d-93ef-cdbdd46861af None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:05.240381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a456d-d560-4899-9b1a-f5040112fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:05.241248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a456d-d560-4899-9b1a-f5040112fb80 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.241524 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a456d-d560-4899-9b1a-f5040112fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.242701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a456d-d560-4899-9b1a-f5040112fb80 None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/5cdab500d7854e69b13a16aa5946df6b/roles/8a313a6550f146259cb001349ea432d9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.263006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a456d-d560-4899-9b1a-f5040112fb80 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=5cdab500d7854e69b13a16aa5946df6b, role_id=8a313a6550f146259cb001349ea432d9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:05.264020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a456d-d560-4899-9b1a-f5040112fb80 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:05.279576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 406/824] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:16:05 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/5cdab500d7854e69b13a16aa5946df6b/roles/8a313a6550f146259cb001349ea432d9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:16:05.280412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a456d-d560-4899-9b1a-f5040112fb80 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:05.281862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9ba5f-f194-4f68-8276-e5b8ce187443 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:05.331471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f448-79ac-4371-9674-8f58b5f0290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:05.333154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f448-79ac-4371-9674-8f58b5f0290e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.333697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f448-79ac-4371-9674-8f58b5f0290e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.334533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f448-79ac-4371-9674-8f58b5f0290e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.363990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:05.440051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f448-79ac-4371-9674-8f58b5f0290e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:05.441565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4f448-79ac-4371-9674-8f58b5f0290e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:05.451197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a456d-d560-4899-9b1a-f5040112fb80 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:05.481450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:05.496358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:05.496971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.497255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.497535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.498416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] RBAC: Adding query filter params (type=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:05.498728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:05.500824 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:05.511304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 407/825] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:05.513883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:05.599066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 419/826] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:05.602946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f448-79ac-4371-9674-8f58b5f0290e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:05.665165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784dfc-347d-4f23-b3b1-1a507e1c54dc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:05.724336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f448-79ac-4371-9674-8f58b5f0290e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:05.724700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd631ad3-2c76-444c-a26f-2717121bcea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:05.725677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd631ad3-2c76-444c-a26f-2717121bcea3 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.726155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd631ad3-2c76-444c-a26f-2717121bcea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.726621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd631ad3-2c76-444c-a26f-2717121bcea3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.727738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd631ad3-2c76-444c-a26f-2717121bcea3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:05.729347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd631ad3-2c76-444c-a26f-2717121bcea3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:05.739205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:05.761702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 408/827] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:16:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:05.763248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a46f4-becc-43c3-a888-e57c07855d9a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.763539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a46f4-becc-43c3-a888-e57c07855d9a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.763817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a46f4-becc-43c3-a888-e57c07855d9a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.770104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 409/828] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:05.771869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1cfe4-2f96-4af9-ac27-a4c20321d5b3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.772170 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1cfe4-2f96-4af9-ac27-a4c20321d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.772455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1cfe4-2f96-4af9-ac27-a4c20321d5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.792138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-64c1cfe4-2f96-4af9-ac27-a4c20321d5b3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:05.793482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-64c1cfe4-2f96-4af9-ac27-a4c20321d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:05.884406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 410/829] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:05.891406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:05.908317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1cfe4-2f96-4af9-ac27-a4c20321d5b3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:05.959524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:05.960370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:05.960647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:05.960916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:05.982188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:05.985448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:06.005307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:06.006440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:06.007395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:06.007395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:06.007395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:06.007395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:06.009082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 420/830] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:06.017343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:06.056190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1cfe4-2f96-4af9-ac27-a4c20321d5b3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.074691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:06.106902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afffee-ed0a-4232-a6bc-9003736f7190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.108104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afffee-ed0a-4232-a6bc-9003736f7190 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.108651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afffee-ed0a-4232-a6bc-9003736f7190 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.109120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afffee-ed0a-4232-a6bc-9003736f7190 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.124516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afffee-ed0a-4232-a6bc-9003736f7190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-63afffee-ed0a-4232-a6bc-9003736f7190 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:06.133535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:06.134483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:06.135457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:06.136088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb6874-01d5-46a4-bb39-964d03de7d21 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.138485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 411/831] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:06.148933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afffee-ed0a-4232-a6bc-9003736f7190 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:06.182285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.182987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.183279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.183555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.184304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:06.184726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:06.186347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.203426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 421/832] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:06.216082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:06.263003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:06.284293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afffee-ed0a-4232-a6bc-9003736f7190 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.329916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.330724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.331081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.331417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.332752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:06.333123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:06.334991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.347027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 412/833] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:06.348141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be1dc-4ae4-48bf-b437-56d74dd053b1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.352334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:06.394383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98246331-312f-4b75-b561-a501f31c677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.395326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98246331-312f-4b75-b561-a501f31c677e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.395612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98246331-312f-4b75-b561-a501f31c677e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.395892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98246331-312f-4b75-b561-a501f31c677e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.403415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98246331-312f-4b75-b561-a501f31c677e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:06.404957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98246331-312f-4b75-b561-a501f31c677e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.408513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-98246331-312f-4b75-b561-a501f31c677e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:06.422381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:06.423587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:06.424751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:06.424751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:06.424751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:06.424751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:06.424751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:06.424751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:06.424751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:06.424751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:06.427112 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 422/834] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:06.433452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98246331-312f-4b75-b561-a501f31c677e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:06.482352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc325d1-43a0-4bc9-830b-79b7dd018df8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.533555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.534559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.534670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.534950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.547202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:06.548593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.557818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:06.566291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:06.567274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:06.568190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:06.568190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:06.568190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:06.568190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:06.568190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 413/835] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:06.576269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:06.582490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98246331-312f-4b75-b561-a501f31c677e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.624192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.625455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.625855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.626232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.627170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:06.629640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:06.631275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.650416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 423/836] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:06.652517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:06.698774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:06.711838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31cbb-d736-4b2d-b924-06d33ef52395 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.757510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.758770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.759251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.760067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.760973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:06.761448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:06.763710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.776147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa2c36-edca-44ca-9208-24c2f8222a7c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.785374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 414/837] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:06.786516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:06.824071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.825174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.825628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.826069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.827097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=29c52f8ffcc34046ac3ade9723bf8b89) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:06.827614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:06.829361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.836218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 424/838] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/role_assignments?user.id=29c52f8ffcc34046ac3ade9723bf8b89&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:06.913870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250bd69-137a-49a6-9488-eced587aae7b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:06.958997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:06.958997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:06.958997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:06.958997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:06.965155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:06.966647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:06.984047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:06.985059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:06.986449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 415/839] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:06.991328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:07.011196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:07.109404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c4a0-ef5e-445a-b0cf-f61a944d6ffb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:07.145142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ccb35-f829-4f68-92b4-d1abf1d13606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:07.145817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccb35-f829-4f68-92b4-d1abf1d13606 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.146149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccb35-f829-4f68-92b4-d1abf1d13606 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.146427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ccb35-f829-4f68-92b4-d1abf1d13606 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.148017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ccb35-f829-4f68-92b4-d1abf1d13606 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:07.148455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ccb35-f829-4f68-92b4-d1abf1d13606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:07.150332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ccb35-f829-4f68-92b4-d1abf1d13606 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:07.170017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 425/840] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jul 20 15:16:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:07.175641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:07.191002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:07.286478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc19d9-6439-48b3-924a-4d5fe43975a8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:07.321798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2633-e9f6-4f46-8b65-1d33f896b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:07.322508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2633-e9f6-4f46-8b65-1d33f896b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.322843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2633-e9f6-4f46-8b65-1d33f896b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.323169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2633-e9f6-4f46-8b65-1d33f896b0e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.395225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc2633-e9f6-4f46-8b65-1d33f896b0e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:07.396801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc2633-e9f6-4f46-8b65-1d33f896b0e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:07.411252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:07.457520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc0b6-5c5f-452d-9476-3fb85a31bf78 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.458049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc0b6-5c5f-452d-9476-3fb85a31bf78 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.458049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc0b6-5c5f-452d-9476-3fb85a31bf78 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.459676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 426/841] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:07.464315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e266-22ce-4839-bf96-951aacf5cf85 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.464641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e266-22ce-4839-bf96-951aacf5cf85 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.464862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e266-22ce-4839-bf96-951aacf5cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.481916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ed81e266-22ce-4839-bf96-951aacf5cf85 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:07.483146 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ed81e266-22ce-4839-bf96-951aacf5cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:07.501410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 416/842] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:07.506799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2633-e9f6-4f46-8b65-1d33f896b0e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:07.557096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:07.568045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 427/843] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:07.589718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81e266-22ce-4839-bf96-951aacf5cf85 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:07.619462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2633-e9f6-4f46-8b65-1d33f896b0e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:07.633406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:07.661974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c708ca-091f-4908-9710-be2c5a3f2c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:07.663208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c708ca-091f-4908-9710-be2c5a3f2c46 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.663503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c708ca-091f-4908-9710-be2c5a3f2c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.664446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c708ca-091f-4908-9710-be2c5a3f2c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.677240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c708ca-091f-4908-9710-be2c5a3f2c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:07.678813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c708ca-091f-4908-9710-be2c5a3f2c46 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c2c708ca-091f-4908-9710-be2c5a3f2c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:07.696764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:07.697721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:07.698634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:07.698634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:07.698634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:07.698634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:07.702687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 417/844] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:07.704056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2070-5f52-4e76-a119-22094fc96eb1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.704344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2070-5f52-4e76-a119-22094fc96eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.704621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2070-5f52-4e76-a119-22094fc96eb1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.706035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 418/845] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:07.706583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2070-5f52-4e76-a119-22094fc96eb1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:07.718386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81e266-22ce-4839-bf96-951aacf5cf85 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:07.753883 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607ac23-675d-4a1b-8b20-e1865c228fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:07.754692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607ac23-675d-4a1b-8b20-e1865c228fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.754992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607ac23-675d-4a1b-8b20-e1865c228fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.755270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607ac23-675d-4a1b-8b20-e1865c228fa2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.755925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607ac23-675d-4a1b-8b20-e1865c228fa2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:07.757373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607ac23-675d-4a1b-8b20-e1865c228fa2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f607ac23-675d-4a1b-8b20-e1865c228fa2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:07.769245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:07.770424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:07.771296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 428/846] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:07.772150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7341-12fc-4928-9684-88bc939b241a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.772321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7341-12fc-4928-9684-88bc939b241a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.772598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7341-12fc-4928-9684-88bc939b241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.789601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3ddb7341-12fc-4928-9684-88bc939b241a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:07.790788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ddb7341-12fc-4928-9684-88bc939b241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:07.818719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2070-5f52-4e76-a119-22094fc96eb1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:07.849732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:07.854653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:07.855396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:07.855678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:07.855952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:07.856802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:07.857143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:07.858527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:07.867156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 429/847] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:07.867156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7341-12fc-4928-9684-88bc939b241a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:07.881246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 419/848] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:07.882001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:07.911506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:07.980488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7341-12fc-4928-9684-88bc939b241a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:07.989348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40559cc-636e-4747-96e8-90baabd3b53b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.015959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.016627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.016938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.017204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.017861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:08.018262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.019574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.023979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.028707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 430/849] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:08.028859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.028859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.029025 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:08.029109 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.036168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.037668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:08.051588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:08.052485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:08.053465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 420/850] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:08.053967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:08.092810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:08.142680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9096148-ad0a-4b9a-ac66-9bf17d579338 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.147019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:08.165872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db123-1c25-4a1f-b0ad-1c814cbc2f74 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.179051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129160d-9a33-408d-80f0-dbf585368772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.179892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129160d-9a33-408d-80f0-dbf585368772 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.180116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129160d-9a33-408d-80f0-dbf585368772 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.180399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129160d-9a33-408d-80f0-dbf585368772 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.190693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129160d-9a33-408d-80f0-dbf585368772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3129160d-9a33-408d-80f0-dbf585368772 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:08.198388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:08.199347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:08.200296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 431/851] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:08.201052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129160d-9a33-408d-80f0-dbf585368772 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:08.204936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.205610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.205885 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.206152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.206853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:08.207182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.208567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.213404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 421/852] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:08.214145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:08.336404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7895b-4640-4013-a445-f46865135841 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.343583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129160d-9a33-408d-80f0-dbf585368772 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.362002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:08.376758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.377458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.377725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.377991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.378748 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:08.379095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.380702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.387942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.388620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.388899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.389168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.389972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:08.390275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.391773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.393917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 422/853] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:08.399717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:08.410933 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 432/854] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:08.416307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:08.416541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:08.515107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aceab52-50ac-40e1-9bf8-a002a4dcbcfd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.535923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3adcb-19f2-4019-b9c6-3acb4e493d12 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.551527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.552486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.552769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.553103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.564830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.566298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.578529 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.579236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.579519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.579794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.581132 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=8db8ce1a1d9143c491304d0b72ace736) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:08.581447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.583218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.595300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 433/855] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/role_assignments?user.id=8db8ce1a1d9143c491304d0b72ace736&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:08.595490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:08.596298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:08.597185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:08.597185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:08.597185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:08.597185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:08.603064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 423/856] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:08.604449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:08.653658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:08.723052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b73e-65ec-4190-8a22-e946c7493207 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.760372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.761310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.761766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.762178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.763087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:08.763533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.765089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.779590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 434/857] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:08.785432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:08.855041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:08.896547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ab964-a9c4-4099-939d-6d18de2b58c7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:08.930769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9be0c2-b455-47e2-b500-37e0e847df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:08.931640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be0c2-b455-47e2-b500-37e0e847df4f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:08.931967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be0c2-b455-47e2-b500-37e0e847df4f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:08.932236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be0c2-b455-47e2-b500-37e0e847df4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:08.947691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9be0c2-b455-47e2-b500-37e0e847df4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:08.949173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9be0c2-b455-47e2-b500-37e0e847df4f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0b9be0c2-b455-47e2-b500-37e0e847df4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:08.964728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:08.965713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:08.966690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 424/858] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:08.971998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:09.029352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f42b56-8949-435d-84ad-e253593154ff None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.029750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f42b56-8949-435d-84ad-e253593154ff None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.029919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f42b56-8949-435d-84ad-e253593154ff None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.031704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 425/859] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:09.041003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becbd67-64f4-4ab7-b46a-ec556d7fa7f3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.041413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becbd67-64f4-4ab7-b46a-ec556d7fa7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.041939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becbd67-64f4-4ab7-b46a-ec556d7fa7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.064033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0becbd67-64f4-4ab7-b46a-ec556d7fa7f3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:09.065573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0becbd67-64f4-4ab7-b46a-ec556d7fa7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:09.090195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:09.095415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794845-ba10-4ee1-9205-c8b7303060f2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:09.143024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:09.144728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.145376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.145753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.146993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:09.147401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:09.149700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:09.157049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 426/860] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:09.171086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 435/861] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jul 20 15:16:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:09.176427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becbd67-64f4-4ab7-b46a-ec556d7fa7f3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:09.183591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:09.243173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:09.291564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becbd67-64f4-4ab7-b46a-ec556d7fa7f3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:09.310919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89480a1-94b9-464d-bb9a-93f2a7cbf61f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:09.325522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd780e2e-3383-45da-9b7b-42f87aa606ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:09.326183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd780e2e-3383-45da-9b7b-42f87aa606ae None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.326462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd780e2e-3383-45da-9b7b-42f87aa606ae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.326725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd780e2e-3383-45da-9b7b-42f87aa606ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.349559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:09.350774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.351304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.351823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.352793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:09.354503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:09.368028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:09.369087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:09.370301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:09.372662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 436/862] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Jul 20 15:16:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:09.378238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:09.406348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:09.419241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd780e2e-3383-45da-9b7b-42f87aa606ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:09.419241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd780e2e-3383-45da-9b7b-42f87aa606ae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:09.470759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:09.490917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f4f3-7fb8-4d04-9385-b220317828cd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:09.524815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 427/863] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:09.525806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd780e2e-3383-45da-9b7b-42f87aa606ae None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:09.528308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:09.529231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.530012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.530460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.531375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:09.531873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:09.533429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:09.539484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 437/864] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:09.545323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:09.629452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd780e2e-3383-45da-9b7b-42f87aa606ae None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:09.652613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300253c7-b3db-4a5a-9e16-3832825cb0c6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:09.661144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:09.663394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:09.664198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.664473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.664743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.674847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:09.676355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:09.690540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:09.691436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.691887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.692305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.693151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:09.693671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:09.695272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:09.696462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:09.697496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:09.698616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:09.698616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:09.698616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:09.698616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:09.699108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 428/865] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:09.704468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:09.706401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 438/866] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:09.708550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:09.820930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06bde9-8783-4ba5-a18d-8ac7331e5a6c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:09.862815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:09.864062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:09.864584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:09.865135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:09.866131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:09.866654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:09.868322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:09.883252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 429/867] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:09.892168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:10.008955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f857b-e2f9-4cff-9fb6-7ab1ea764e2d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:10.044715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:10.045947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:10.046468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:10.046990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:10.054343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:10.056055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:10.070419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:10.071419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:10.072318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:10.072318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:10.072318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:10.072318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:10.072318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:10.072318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:10.072318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:10.072318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:10.074768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 439/868] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:10.084046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:10.149192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:10.194103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ecdff-6524-4d9c-8be3-3b4c362c7b78 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:10.229603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d94b6-af0b-401d-bdee-4abe299d953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:10.230276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d94b6-af0b-401d-bdee-4abe299d953b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:10.230601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d94b6-af0b-401d-bdee-4abe299d953b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:10.230875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d94b6-af0b-401d-bdee-4abe299d953b None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:10.231698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d94b6-af0b-401d-bdee-4abe299d953b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:10.232002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d94b6-af0b-401d-bdee-4abe299d953b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:10.233440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d94b6-af0b-401d-bdee-4abe299d953b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:10.246626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 430/869] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:10.252653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:10.268257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:10.353919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44dce-ed5d-4257-af31-fa6d004b9ea6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:10.354113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44dce-ed5d-4257-af31-fa6d004b9ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:10.354375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44dce-ed5d-4257-af31-fa6d004b9ea6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:10.356342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 431/870] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:10.358197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85718c07-b528-4df9-8404-6dcd754638bb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:10.361245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652352d4-f794-40a0-9f99-63e24f9037ed None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:10.361529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652352d4-f794-40a0-9f99-63e24f9037ed None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:10.361805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652352d4-f794-40a0-9f99-63e24f9037ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:10.384180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-652352d4-f794-40a0-9f99-63e24f9037ed None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:10.385663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-652352d4-f794-40a0-9f99-63e24f9037ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:10.399867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:10.401052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:10.401464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:10.401745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:10.402582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=5cdab500d7854e69b13a16aa5946df6b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:10.403186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:10.405385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:10.413425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 440/871] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:10 2022] GET /identity/v3/role_assignments?user.id=5cdab500d7854e69b13a16aa5946df6b&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:10.469874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 432/872] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:10.493981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:10.582357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:10.610515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de3dd9-34dd-4a40-811c-19802ff7a29a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:10.648151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6be56-e76a-4de6-82f9-f5122450e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:10.649446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6be56-e76a-4de6-82f9-f5122450e942 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:10.649770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6be56-e76a-4de6-82f9-f5122450e942 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:10.650045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6be56-e76a-4de6-82f9-f5122450e942 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:10.650781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6be56-e76a-4de6-82f9-f5122450e942 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:10.652560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6be56-e76a-4de6-82f9-f5122450e942 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:10.668659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 441/873] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:16:10 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:10.812450 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3ab54-7396-471f-91be-3dbe88cdd9de None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:10.813130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3ab54-7396-471f-91be-3dbe88cdd9de None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:10.813623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3ab54-7396-471f-91be-3dbe88cdd9de None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:10.815635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 433/874] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:10.821767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da7ebd-e9ef-4c6c-87b1-c6728d0cca58 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:10.822332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da7ebd-e9ef-4c6c-87b1-c6728d0cca58 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:10.822812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da7ebd-e9ef-4c6c-87b1-c6728d0cca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:10.840582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-84da7ebd-e9ef-4c6c-87b1-c6728d0cca58 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:10.842013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-84da7ebd-e9ef-4c6c-87b1-c6728d0cca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:10.920469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 442/875] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:10.951328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3ab54-7396-471f-91be-3dbe88cdd9de None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:11.014197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:11.061483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3ab54-7396-471f-91be-3dbe88cdd9de None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:11.097042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:11.097858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:11.098186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:11.098463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:11.099152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:11.100578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:11.113160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:11.114174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:11.115037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 434/876] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:11.121133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da7ebd-e9ef-4c6c-87b1-c6728d0cca58 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:11.183670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:11.228748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da7ebd-e9ef-4c6c-87b1-c6728d0cca58 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:11.265053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ef8d-5eab-4673-8fe9-df9a443a4dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:11.265787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ef8d-5eab-4673-8fe9-df9a443a4dcb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:11.266069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ef8d-5eab-4673-8fe9-df9a443a4dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:11.266345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ef8d-5eab-4673-8fe9-df9a443a4dcb None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:11.267133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ef8d-5eab-4673-8fe9-df9a443a4dcb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:11.267441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ef8d-5eab-4673-8fe9-df9a443a4dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:11.268851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ef8d-5eab-4673-8fe9-df9a443a4dcb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:11.274149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 443/877] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:11.279853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:11.385910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e736963-7b58-49d7-bddf-a6d9b4dac8ea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:11.418299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:11.421252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87818987-e591-40f2-8201-6ba7a2557b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:11.421940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818987-e591-40f2-8201-6ba7a2557b93 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:11.426083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818987-e591-40f2-8201-6ba7a2557b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:11.426083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87818987-e591-40f2-8201-6ba7a2557b93 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:11.426083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87818987-e591-40f2-8201-6ba7a2557b93 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:11.426083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87818987-e591-40f2-8201-6ba7a2557b93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:11.426083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87818987-e591-40f2-8201-6ba7a2557b93 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:11.430012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 435/878] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:11.906400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f058b0-e9d2-4866-9c04-6bb2edc03cae None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:11.906930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f058b0-e9d2-4866-9c04-6bb2edc03cae None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:11.906930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f058b0-e9d2-4866-9c04-6bb2edc03cae None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:11.908593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 444/879] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:11.913805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b870c8-a45c-4a82-8903-ee123fc594dd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:11.914090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b870c8-a45c-4a82-8903-ee123fc594dd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:11.914369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b870c8-a45c-4a82-8903-ee123fc594dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:11.931601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-77b870c8-a45c-4a82-8903-ee123fc594dd None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:11.932795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77b870c8-a45c-4a82-8903-ee123fc594dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:12.009893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 436/880] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:12.032114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f058b0-e9d2-4866-9c04-6bb2edc03cae None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:12.135797 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f058b0-e9d2-4866-9c04-6bb2edc03cae None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:12.159999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:12.171649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cab3b-2f05-40cb-9217-aa87ac4daae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:12.172633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cab3b-2f05-40cb-9217-aa87ac4daae1 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:12.173109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cab3b-2f05-40cb-9217-aa87ac4daae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:12.173575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cab3b-2f05-40cb-9217-aa87ac4daae1 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:12.174506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cab3b-2f05-40cb-9217-aa87ac4daae1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:12.176124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cab3b-2f05-40cb-9217-aa87ac4daae1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:12.193441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 445/881] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:16:12 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:16:12.584709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8e8f-30ec-45d8-87fa-606212435fdb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:12.585115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8e8f-30ec-45d8-87fa-606212435fdb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:12.585312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee8e8f-30ec-45d8-87fa-606212435fdb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:12.587022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 437/882] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:12.593259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf3199-321a-45b9-8bc7-9637ed7d3465 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:12.593535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf3199-321a-45b9-8bc7-9637ed7d3465 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:12.593812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf3199-321a-45b9-8bc7-9637ed7d3465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:12.610904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bbdf3199-321a-45b9-8bc7-9637ed7d3465 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:12.612185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bbdf3199-321a-45b9-8bc7-9637ed7d3465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:12.691077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 446/883] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:12.709206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee8e8f-30ec-45d8-87fa-606212435fdb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:12.812136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee8e8f-30ec-45d8-87fa-606212435fdb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:12.831436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:12.849053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5756954-35fc-40a0-9e0c-4e592262bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:12.849866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5756954-35fc-40a0-9e0c-4e592262bb7d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:12.850148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5756954-35fc-40a0-9e0c-4e592262bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:12.850423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5756954-35fc-40a0-9e0c-4e592262bb7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:12.858085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba20a7e-2168-4ce0-8ec6-b21a1efdcd4e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:12.858371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba20a7e-2168-4ce0-8ec6-b21a1efdcd4e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:12.858636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba20a7e-2168-4ce0-8ec6-b21a1efdcd4e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:12.860302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 447/884] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:12.861064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5756954-35fc-40a0-9e0c-4e592262bb7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:12.865587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e246272-1129-438f-9438-324b8ac65c70 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:12.866083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e246272-1129-438f-9438-324b8ac65c70 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:12.866551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e246272-1129-438f-9438-324b8ac65c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f5756954-35fc-40a0-9e0c-4e592262bb7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:12.869265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:12.870523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:12.871405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 438/885] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jul 20 15:16:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:12.877294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5756954-35fc-40a0-9e0c-4e592262bb7d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:12.888056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1e246272-1129-438f-9438-324b8ac65c70 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:12.889630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1e246272-1129-438f-9438-324b8ac65c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:12.979360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 448/886] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:12.997418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e246272-1129-438f-9438-324b8ac65c70 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.001743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5756954-35fc-40a0-9e0c-4e592262bb7d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.041290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.042744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.043259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.043724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.044658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:13.045179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.046748 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.047447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:13.057785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 439/887] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jul 20 15:16:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:13.067017 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.099891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:13.123541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e246272-1129-438f-9438-324b8ac65c70 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.168375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.169443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.169719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.169995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.171077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.172737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.177087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faf85a-6cb6-40e4-9700-6923ee9e763f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:13.188263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:13.189358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:13.190398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 449/888] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:13.195487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.220989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.222284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.222824 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.223345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.235425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.237266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:13.256584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:13.257534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:13.258440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:13.258440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:13.258440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:13.258440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:13.265527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 440/889] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:13.267170 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.300091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe946d4-a4b9-4cf1-be84-f47fbf34570c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.302510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:13.339509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.340138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.340415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.340685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.341416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:13.341717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.343292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.353575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 450/890] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:13.354691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.366015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:13.387928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53f28c-1c68-4e6a-9f3d-32b6d7fcb849 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.425894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.426995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.427500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.427965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.428972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:13.429453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.431218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.449412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 441/891] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:13.451120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.465797 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db396c3-2e70-4d35-afd3-503fce8ca24f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.501966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.502742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.503128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.503461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.504233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:13.504596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.506320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.516375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 451/892] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:13.517412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.549362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:13.561363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05805c-40e7-411b-8a33-dce8335622ca None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.599221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dabe2b-3d26-491e-9cdc-300bffee7026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.600517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabe2b-3d26-491e-9cdc-300bffee7026 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.600795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabe2b-3d26-491e-9cdc-300bffee7026 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.601066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dabe2b-3d26-491e-9cdc-300bffee7026 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.610281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dabe2b-3d26-491e-9cdc-300bffee7026 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.612421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dabe2b-3d26-491e-9cdc-300bffee7026 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.620596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85821b1-962b-4cf2-ae83-0fe1aba6598f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-32dabe2b-3d26-491e-9cdc-300bffee7026 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:13.628483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:13.629402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:13.630326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:13.634481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 442/893] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:13.635731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0a2c-01bf-47ec-8893-c66dddc7fe38 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.636267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0a2c-01bf-47ec-8893-c66dddc7fe38 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.636267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0a2c-01bf-47ec-8893-c66dddc7fe38 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.637766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 443/894] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:13.638311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d0a2c-01bf-47ec-8893-c66dddc7fe38 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.647456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:13.663021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b630-2ae3-448f-a5e7-392e18b49cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.663691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b630-2ae3-448f-a5e7-392e18b49cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.663973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b630-2ae3-448f-a5e7-392e18b49cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.664246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b630-2ae3-448f-a5e7-392e18b49cc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.665031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91b630-2ae3-448f-a5e7-392e18b49cc2 None admin] RBAC: Adding query filter params (interface=public, service_id=2f9a83ccd4924b9e9061a04440b1d586, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:13.665344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91b630-2ae3-448f-a5e7-392e18b49cc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.666730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91b630-2ae3-448f-a5e7-392e18b49cc2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.671898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 452/895] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/endpoints?service_id=2f9a83ccd4924b9e9061a04440b1d586&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:13.673344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddb31-5c7b-46ee-aafa-0e277e86484b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.673821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddb31-5c7b-46ee-aafa-0e277e86484b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.674282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddb31-5c7b-46ee-aafa-0e277e86484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.691079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a06ddb31-5c7b-46ee-aafa-0e277e86484b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:13.692249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a06ddb31-5c7b-46ee-aafa-0e277e86484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:13.758694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d0a2c-01bf-47ec-8893-c66dddc7fe38 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.774993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 453/896] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:13.774993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddb31-5c7b-46ee-aafa-0e277e86484b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.796619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:13.807115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.807852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.808132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.808401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.809244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:13.809599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.811058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.834418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 444/897] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:13.834418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.879446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddb31-5c7b-46ee-aafa-0e277e86484b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:13.905514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:13.921533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac415712-96c2-404e-a62a-e34582b9f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:13.922313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415712-96c2-404e-a62a-e34582b9f494 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:13.922591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415712-96c2-404e-a62a-e34582b9f494 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:13.922861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415712-96c2-404e-a62a-e34582b9f494 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:13.923593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac415712-96c2-404e-a62a-e34582b9f494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:13.924973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac415712-96c2-404e-a62a-e34582b9f494 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:13.938997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 454/898] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:16:13.938997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac415712-96c2-404e-a62a-e34582b9f494 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:13.964536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe1268-38f1-4a33-8619-a299673b569b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:14.016540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1291f-b045-4f0f-b603-1335f1f2acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:14.017247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1291f-b045-4f0f-b603-1335f1f2acb8 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.017526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1291f-b045-4f0f-b603-1335f1f2acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.018136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1291f-b045-4f0f-b603-1335f1f2acb8 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.018938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1291f-b045-4f0f-b603-1335f1f2acb8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:14.021398 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1291f-b045-4f0f-b603-1335f1f2acb8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:14.044436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 445/899] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:16:13 2022] POST /identity/v3/services => generated 241 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:14.047224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:14.063435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac415712-96c2-404e-a62a-e34582b9f494 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:14.114366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3961-8248-4727-bd60-5a1f078c9f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:14.115084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3961-8248-4727-bd60-5a1f078c9f92 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.115443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3961-8248-4727-bd60-5a1f078c9f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.115834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3961-8248-4727-bd60-5a1f078c9f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.194899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f3961-8248-4727-bd60-5a1f078c9f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:14.196496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f3961-8248-4727-bd60-5a1f078c9f92 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:14.265032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532a75-3a6b-4a08-8503-edb9c6bfe9cc None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.265375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532a75-3a6b-4a08-8503-edb9c6bfe9cc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.265599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec532a75-3a6b-4a08-8503-edb9c6bfe9cc None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.267143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 446/900] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:14.272049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502984-e4a0-4470-a1f7-76691d576d63 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.272644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502984-e4a0-4470-a1f7-76691d576d63 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.273134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502984-e4a0-4470-a1f7-76691d576d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.289774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:14.293867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9e502984-e4a0-4470-a1f7-76691d576d63 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:14.295128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9e502984-e4a0-4470-a1f7-76691d576d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:14.309592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 455/901] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:13 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:14.315027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3961-8248-4727-bd60-5a1f078c9f92 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:14.381796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 447/902] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:14.404074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502984-e4a0-4470-a1f7-76691d576d63 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:14.434608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3961-8248-4727-bd60-5a1f078c9f92 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:14.462934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:14.472182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:14.473041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.473344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.473589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.484206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:14.485680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:14.503931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:14.504866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:14.505759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:14.505759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:14.505759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:14.505759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:14.509993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 456/903] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:14.511065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:14.513309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502984-e4a0-4470-a1f7-76691d576d63 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:14.547958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:14.548791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.549068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.549340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.549999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:14.551428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:14.554698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:14.564157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:14.565125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:14.565961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 448/904] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Jul 20 15:16:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:14.573591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:14.624180 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ddd0c-2e25-4a86-b9db-bd293bbb663d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:14.668513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:14.669190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.669468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.669743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.670472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:14.670779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:14.672220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:14.688786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 457/905] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:14.690031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:14.693376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431241c-c5c6-4d39-9034-22f84a30e35a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:14.717297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:14.735559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:14.736467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.736840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.737210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.738020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:14.738420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:14.739942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:14.750454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 449/906] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:14.751708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:14.815159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:14.820460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c4e37-0cde-41d8-b388-a0af3f22c245 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:14.862043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e188ae4-56d3-40c7-adb1-d22b53ec459b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:14.867710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:14.868520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.868797 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.869068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.879836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:14.883479 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:14.902162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:14.903259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:14.904140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:14.904140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:14.904140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:14.904140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:14.904140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:14.904140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:14.904140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:14.904140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:14.904587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:14.904587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:14.904733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:14.905704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:14.906537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:14.906926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 458/907] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:14.907296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:14.909518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:14.914923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:14.922024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 450/908] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:14.923281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:14.972173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:15.026616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad3c68-99ee-4e8e-aa13-32797a2473b5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:15.039539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e749ce6-06a5-42b1-bb9f-affecbefcb34 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:15.060141 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:15.060851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:15.061159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:15.061497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:15.062369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] RBAC: Adding query filter params (interface=public, service_id=f093be4559f046c5aa7d9ef603cdc0dc, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:15.063004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:15.064294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:15.074505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 451/909] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jul 20 15:16:14 2022] GET /identity/v3/endpoints?service_id=f093be4559f046c5aa7d9ef603cdc0dc&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:15.076094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:15.078819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:15.080157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:15.080685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:15.081186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:15.082204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:15.082700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:15.084421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:15.097919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 459/910] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:15.105598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:15.128148 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:15.205561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615644e-fda5-47c9-8efa-de8903d6c276 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:15.229930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfa1c4-c7c3-44b9-a416-df0bab1baaba None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:15.230777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:15.251679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b558cf-2772-4cac-bbf5-78485cbdb979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:15.252377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b558cf-2772-4cac-bbf5-78485cbdb979 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:15.252658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b558cf-2772-4cac-bbf5-78485cbdb979 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:15.252930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b558cf-2772-4cac-bbf5-78485cbdb979 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:15.253735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b558cf-2772-4cac-bbf5-78485cbdb979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:15.255214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b558cf-2772-4cac-bbf5-78485cbdb979 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:15.262278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 452/911] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:16:15 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:16:15.275145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1930c-6068-414b-9482-716965eedb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:15.275838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1930c-6068-414b-9482-716965eedb84 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:15.276118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1930c-6068-414b-9482-716965eedb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:15.276438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1930c-6068-414b-9482-716965eedb84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:15.277322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1930c-6068-414b-9482-716965eedb84 None admin] RBAC: Adding query filter params (role.id=390c2ce1ea864379bfee5f65891dcb44, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=5cdab500d7854e69b13a16aa5946df6b) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:15.277686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1930c-6068-414b-9482-716965eedb84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:15.279267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1930c-6068-414b-9482-716965eedb84 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:15.286495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 460/912] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:15 2022] GET /identity/v3/role_assignments?user.id=5cdab500d7854e69b13a16aa5946df6b&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=390c2ce1ea864379bfee5f65891dcb44 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:16.071097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd817-0c79-4a60-a960-7cf60e9b7050 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.071699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd817-0c79-4a60-a960-7cf60e9b7050 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.071699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd817-0c79-4a60-a960-7cf60e9b7050 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.073312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 453/913] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:16.080788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78698-bb88-4914-a33b-79a50385fa9b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.081703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78698-bb88-4914-a33b-79a50385fa9b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.082191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78698-bb88-4914-a33b-79a50385fa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.101670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-70b78698-bb88-4914-a33b-79a50385fa9b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:16.103214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-70b78698-bb88-4914-a33b-79a50385fa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:16.173687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 461/914] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:16.176849 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9676-f25e-473a-a4ee-c75c5d046eb1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.177388 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9676-f25e-473a-a4ee-c75c5d046eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.177956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9676-f25e-473a-a4ee-c75c5d046eb1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.179785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 454/915] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:16.185018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c23f-e3de-4945-aa82-5586a563381d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.185530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c23f-e3de-4945-aa82-5586a563381d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.185995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c23f-e3de-4945-aa82-5586a563381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.196503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9676-f25e-473a-a4ee-c75c5d046eb1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:16.203921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4a22c23f-e3de-4945-aa82-5586a563381d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:16.205044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4a22c23f-e3de-4945-aa82-5586a563381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:16.214777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:16.295058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 462/916] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:16.313162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9676-f25e-473a-a4ee-c75c5d046eb1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:16.317155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c23f-e3de-4945-aa82-5586a563381d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:16.352560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:16.353866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.354195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.354668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.355536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:16.357100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:16.370856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:16.371972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:16:16.372862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:16.375804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 455/917] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:16.381322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:16.428190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c23f-e3de-4945-aa82-5586a563381d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:16.428527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:16.465545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:16.466778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.467297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.467777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.468645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:16.470282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:16.483234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:16.484270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:16.485084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:16.492906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 463/918] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:16.494031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:16.497819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509177a-890f-45a6-923f-e171cc7aed70 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:16.504954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:16.537711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:16.538791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.539265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.539701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.542094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:16.542749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:16.544397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:16.555005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 456/919] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:16.556255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:16.596121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d254c0-593c-4f19-89e9-9eb5280f9db5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:16.629793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:16.630580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.631190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.631678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.632568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:16.633063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:16.634643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:16.644669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 464/920] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:16.646122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:16.664021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79651e-f29c-4cc6-a56e-24b636e1d51b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:16.665916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:16.704781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:16.705454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.705725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.705989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.706707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:16.708110 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:16.709486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:16.717778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 457/921] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jul 20 15:16:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:16.725952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:16.727232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:16.761210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef3537-353c-482c-b0b5-9335b731a4ac None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:16.796289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:16.797030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.797316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.797591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.798304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:16.798610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:16.800054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:16.810326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 465/922] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:16.811394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:16.855421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a1bd8-862e-457c-87d3-251727d740e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:16.892623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf851a0-d326-4270-be5e-06ec24bb132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:16.893381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf851a0-d326-4270-be5e-06ec24bb132e None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.893661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf851a0-d326-4270-be5e-06ec24bb132e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.893932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf851a0-d326-4270-be5e-06ec24bb132e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.894773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf851a0-d326-4270-be5e-06ec24bb132e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:16.896209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf851a0-d326-4270-be5e-06ec24bb132e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:16.919957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea37c07-fe5d-4e8a-a58d-2ded7e79ecc7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:16.924499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 458/923] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:16:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:16.976604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:16.983236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f97f43-2fc8-4aff-bded-ddafcf230a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:16.983922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97f43-2fc8-4aff-bded-ddafcf230a6a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:16.984399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97f43-2fc8-4aff-bded-ddafcf230a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:16.984687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97f43-2fc8-4aff-bded-ddafcf230a6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:16.985511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f97f43-2fc8-4aff-bded-ddafcf230a6a None admin] RBAC: Adding query filter params (interface=public, service_id=d8d5754e316c418e90d2f85356efb88f, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:16.985824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f97f43-2fc8-4aff-bded-ddafcf230a6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:16.987307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f97f43-2fc8-4aff-bded-ddafcf230a6a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:16.994506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 466/924] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jul 20 15:16:16 2022] GET /identity/v3/endpoints?service_id=d8d5754e316c418e90d2f85356efb88f&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:17.004213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf851a0-d326-4270-be5e-06ec24bb132e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:17.033507 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:17.121249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf851a0-d326-4270-be5e-06ec24bb132e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:17.156467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf57b8-aaa3-45b8-94cd-050ae8a44d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:17.157148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf57b8-aaa3-45b8-94cd-050ae8a44d0c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.157425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf57b8-aaa3-45b8-94cd-050ae8a44d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.157694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf57b8-aaa3-45b8-94cd-050ae8a44d0c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.158438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf57b8-aaa3-45b8-94cd-050ae8a44d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:17.159868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf57b8-aaa3-45b8-94cd-050ae8a44d0c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:17.166301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 459/925] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:16:17 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:16:17.344051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271abe0-f188-461e-800c-58644b814602 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.344569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271abe0-f188-461e-800c-58644b814602 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.344569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271abe0-f188-461e-800c-58644b814602 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.346176 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 467/926] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:17.351771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c35d4-f32b-426a-aab2-03cf2fa52daf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.352058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c35d4-f32b-426a-aab2-03cf2fa52daf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.352335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c35d4-f32b-426a-aab2-03cf2fa52daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.370012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1a7c35d4-f32b-426a-aab2-03cf2fa52daf None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:17.371243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1a7c35d4-f32b-426a-aab2-03cf2fa52daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:17.418931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dff5f-e934-4b10-8387-8719030cc470 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.418931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dff5f-e934-4b10-8387-8719030cc470 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.418931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dff5f-e934-4b10-8387-8719030cc470 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.419791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 468/927] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:17.424909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec268-f0df-403f-83a9-c370b3908574 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.425447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec268-f0df-403f-83a9-c370b3908574 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.425926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec268-f0df-403f-83a9-c370b3908574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.443565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e53ec268-f0df-403f-83a9-c370b3908574 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:17.443877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 460/928] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:17.445414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e53ec268-f0df-403f-83a9-c370b3908574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:17.466731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c35d4-f32b-426a-aab2-03cf2fa52daf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:17.485015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:17.538574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 469/929] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:17.562795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec268-f0df-403f-83a9-c370b3908574 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:17.600085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c35d4-f32b-426a-aab2-03cf2fa52daf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:17.645039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:17.646632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.647312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.647776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.649567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:17.651179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:17.668128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:17.669126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:16:17.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:17.672982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 461/930] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Jul 20 15:16:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:17.683029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:17.687098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec268-f0df-403f-83a9-c370b3908574 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:17.713991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:17.725997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669cfe-76c1-4031-92d5-213bdc676898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:17.727191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669cfe-76c1-4031-92d5-213bdc676898 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.728417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669cfe-76c1-4031-92d5-213bdc676898 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.728803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669cfe-76c1-4031-92d5-213bdc676898 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.741676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02669cfe-76c1-4031-92d5-213bdc676898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-02669cfe-76c1-4031-92d5-213bdc676898 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:17.753061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:17.754029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:17.755019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:17.755685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 470/931] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jul 20 15:16:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:17.761960 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669cfe-76c1-4031-92d5-213bdc676898 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:17.787564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:17.814857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82c5b2-cf25-4041-81b3-c6f419bebf71 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:17.852264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:17.853408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.853896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.854360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.855526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:17.856041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:17.857624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:17.863431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 462/932] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:17.871130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669cfe-76c1-4031-92d5-213bdc676898 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:17.871336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:17.905034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:17.905999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:17.906442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:17.906861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:17.907971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:17.908423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:17.909970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:17.918905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 471/933] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jul 20 15:16:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:17.924129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:17.982611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:18.004823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434f80b-5d0e-4017-a3c6-b460ea9173ba None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:18.042521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc66a6-c09a-4eec-b45b-7693cb3c535d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:18.053728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:18.054830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:18.055152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:18.055449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:18.056432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:18.056747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:18.058403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:18.064989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 463/934] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:18.070636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:18.080769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:18.081996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:18.082527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:18.083058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:18.083695 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:18.097262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:18.099174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:18.117878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:18.118835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:18.120211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:18.120211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:18.120211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:18.120211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:18.127340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 472/935] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:18.128548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:18.180009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda780f1-f64d-4081-b23e-c068b13f21b0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:18.216612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45af026-9d46-44f7-9af6-92c93d05727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:18.217288 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af026-9d46-44f7-9af6-92c93d05727f None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:18.217570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af026-9d46-44f7-9af6-92c93d05727f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:18.217847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45af026-9d46-44f7-9af6-92c93d05727f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:18.218698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45af026-9d46-44f7-9af6-92c93d05727f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:18.220357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45af026-9d46-44f7-9af6-92c93d05727f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:18.240688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:18.242868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 464/936] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:16:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:16:18.246645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3b068-a0ff-47c4-8c9a-fad3039bd1a7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:18.299003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:18.299821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:18.300109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:18.300389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:18.301190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:18.301505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:18.303154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:18.318775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 473/937] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:18.324842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45af026-9d46-44f7-9af6-92c93d05727f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:18.398421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:18.438907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45af026-9d46-44f7-9af6-92c93d05727f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:18.472832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:18.474038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:18.474510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:18.475050 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:18.483195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:18.484931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:18.500363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:18.501336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:18.502305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:18.504905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 465/938] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:16:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:18.510918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:18.615059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0aec-6dd8-491e-8ea7-c64de521894c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:18.651628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:18.652647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:18.653118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:18.653638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:18.654677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:18.655237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:18.656933 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:18.675942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 474/939] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jul 20 15:16:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:18.681785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:18.782902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0030-83db-4c8b-ac9e-86d0ecba3380 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:18.806622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:18.817652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953feb12-de75-45e3-845c-66239808dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:18.818609 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953feb12-de75-45e3-845c-66239808dcee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:18.818929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953feb12-de75-45e3-845c-66239808dcee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:18.819220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953feb12-de75-45e3-845c-66239808dcee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:18.830184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953feb12-de75-45e3-845c-66239808dcee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:18.831673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953feb12-de75-45e3-845c-66239808dcee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-953feb12-de75-45e3-845c-66239808dcee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:18.850031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:18.851002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:18.851926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:18.851926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:18.851926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:18.851926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:18.851926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 466/940] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:18.857525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:18.873487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:18.965975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb6e1-05f6-44bb-a68f-cd7658a56eee None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.001811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:19.002501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.002782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.003089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.003828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:19.004138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:19.005609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:19.022884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 475/941] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:19.028558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953feb12-de75-45e3-845c-66239808dcee None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:19.129413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953feb12-de75-45e3-845c-66239808dcee None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.163472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a631c-467d-450f-8eb3-2cfa6302a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:19.164283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a631c-467d-450f-8eb3-2cfa6302a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.164557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a631c-467d-450f-8eb3-2cfa6302a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.164823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a631c-467d-450f-8eb3-2cfa6302a3f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.171777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a631c-467d-450f-8eb3-2cfa6302a3f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:19.173233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a631c-467d-450f-8eb3-2cfa6302a3f8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-df7a631c-467d-450f-8eb3-2cfa6302a3f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:19.190564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:19.192004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:19.192899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 467/942] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:19.198116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:19.234816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94085-9b90-4db4-89b0-75327f9961ea None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.235147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94085-9b90-4db4-89b0-75327f9961ea None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.235428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94085-9b90-4db4-89b0-75327f9961ea None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.236957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 468/943] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:19.242840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c12f9-9fae-4c15-9157-4d864a44a34b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.243158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c12f9-9fae-4c15-9157-4d864a44a34b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.243976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c12f9-9fae-4c15-9157-4d864a44a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.262208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-891c12f9-9fae-4c15-9157-4d864a44a34b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:19.263448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-891c12f9-9fae-4c15-9157-4d864a44a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:19.275735 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:19.295615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:19.311678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be34a46-6082-4dd9-85d0-4e56a01748f4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.339761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 469/944] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:19.341385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf323-4a21-4d43-9fb5-0424d569b780 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.341663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf323-4a21-4d43-9fb5-0424d569b780 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.341930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf323-4a21-4d43-9fb5-0424d569b780 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.347251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 470/945] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:19.348589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50ecaf-5568-4acb-818c-bb6e1dd2b8f2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.348867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50ecaf-5568-4acb-818c-bb6e1dd2b8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.349136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50ecaf-5568-4acb-818c-bb6e1dd2b8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.361549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:19.362544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.363542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.363836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.364638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:19.364955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:19.366506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:19.369031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ce50ecaf-5568-4acb-818c-bb6e1dd2b8f2 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:19.370566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ce50ecaf-5568-4acb-818c-bb6e1dd2b8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:19.379649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 476/946] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:19.384637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:19.446445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 471/947] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:19.447456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50ecaf-5568-4acb-818c-bb6e1dd2b8f2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:19.517287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872264-03ea-46ba-94e3-e41993c1176b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.553821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:19.555204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:19.559800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:19.560575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.560860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.561137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.561662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50ecaf-5568-4acb-818c-bb6e1dd2b8f2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.561838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:19.563322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:19.565091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING keystone.server.flask.common [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 15:16:19.582924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.sql.core [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 15:16:19.582924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 15:16:19.582924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [parameters: {'id': 'b370e89783c84f358a175806d238a89b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 15:16:19.582924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80224) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b370e89783c84f358a175806d238a89b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b370e89783c84f358a175806d238a89b. Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:16:19.599908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 15:16:19.600798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application yield resource Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise self.value Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application session.commit() Jul 20 15:16:19.601755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.flush() Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application compat.raise_( Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 15:16:19.602673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 15:16:19.603645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:16:19.604448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [parameters: {'id': 'b370e89783c84f358a175806d238a89b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:19.605307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:19.607832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b370e89783c84f358a175806d238a89b. Jul 20 15:16:19.610334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.611577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63768-d635-4858-9fd0-4398824a05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:19.611577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63768-d635-4858-9fd0-4398824a05d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.611577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63768-d635-4858-9fd0-4398824a05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.611577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63768-d635-4858-9fd0-4398824a05d1 None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/5cdab500d7854e69b13a16aa5946df6b/roles/390c2ce1ea864379bfee5f65891dcb44` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.612161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 477/948] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Jul 20 15:16:19 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:19.612161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:19.613534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be63768-d635-4858-9fd0-4398824a05d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=5cdab500d7854e69b13a16aa5946df6b, role_id=390c2ce1ea864379bfee5f65891dcb44)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:19.613534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be63768-d635-4858-9fd0-4398824a05d1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:19.625917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 472/949] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:16:19 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/5cdab500d7854e69b13a16aa5946df6b/roles/390c2ce1ea864379bfee5f65891dcb44 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:16:19.626978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63768-d635-4858-9fd0-4398824a05d1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:19.740786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63768-d635-4858-9fd0-4398824a05d1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.762882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857e013-63c7-423a-af04-7eb883437ada None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.779998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:19.782151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.782435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.782710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.790276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:19.791799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:19.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:19.807862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:19.808754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 473/950] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:19.814451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:19.818688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:19.820472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.820755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.821030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.821695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:19.823427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:19.834680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:19.838555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:19.839721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:19.840563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 478/951] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:19.846194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:19.911700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:19.930701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daab4b7-430c-4686-948c-89d67e5e4bef None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.971211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5e8b3-5860-48bc-928d-e1b64f81374e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:19.979823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:19.980562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:19.980884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:19.981162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:19.981934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:19.982241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:19.986126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:20.011059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 474/952] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:20.015084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:20.016133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:20.016618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:20.017085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:20.018015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:20.018597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:20.020282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:20.029789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 479/953] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:20.035313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:20.129365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:20.156093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17105-3b94-400c-bb9b-bb5eff1b9dac None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:20.192496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7ebc-19bb-4d1c-8050-4a8d47370c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:20.193976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7ebc-19bb-4d1c-8050-4a8d47370c8f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:20.194257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7ebc-19bb-4d1c-8050-4a8d47370c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:20.194531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7ebc-19bb-4d1c-8050-4a8d47370c8f None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:20.195291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b7ebc-19bb-4d1c-8050-4a8d47370c8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:20.195599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b7ebc-19bb-4d1c-8050-4a8d47370c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:20.196988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b7ebc-19bb-4d1c-8050-4a8d47370c8f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:20.202257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 475/954] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:20.207873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:20.315389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72620b-abe9-4535-8c44-5bbd3b3b6e77 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:20.332383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:20.351628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760105f5-dcb0-474e-ad0a-170e3ffc9aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:20.352312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760105f5-dcb0-474e-ad0a-170e3ffc9aac None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:20.352593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760105f5-dcb0-474e-ad0a-170e3ffc9aac None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:20.352869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760105f5-dcb0-474e-ad0a-170e3ffc9aac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:20.353634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760105f5-dcb0-474e-ad0a-170e3ffc9aac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:20.355058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760105f5-dcb0-474e-ad0a-170e3ffc9aac None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:20.379935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 480/955] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:16:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:20.392801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4333a2-7811-46ad-be78-5606211917e3 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:20.393154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4333a2-7811-46ad-be78-5606211917e3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:20.393355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4333a2-7811-46ad-be78-5606211917e3 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:20.395226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 476/956] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:20.401578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7be6e0-eae2-42ac-877f-0eb8070636cb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:20.401932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7be6e0-eae2-42ac-877f-0eb8070636cb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:20.402146 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7be6e0-eae2-42ac-877f-0eb8070636cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:20.421091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8a7be6e0-eae2-42ac-877f-0eb8070636cb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:20.422684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a7be6e0-eae2-42ac-877f-0eb8070636cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:20.504213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 481/957] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:20.527266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4333a2-7811-46ad-be78-5606211917e3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:20.636094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4333a2-7811-46ad-be78-5606211917e3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:20.672128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:20.672944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:20.673222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:20.673494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:20.674158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:20.675623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:20.688011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:20.689137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:20.690049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:20.694274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 477/958] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:20.695707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7be6e0-eae2-42ac-877f-0eb8070636cb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:20.797511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:20.801351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7be6e0-eae2-42ac-877f-0eb8070636cb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:20.845319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c1e4d-dc7f-4233-834c-51af65099a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:20.845998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1e4d-dc7f-4233-834c-51af65099a60 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:20.846272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1e4d-dc7f-4233-834c-51af65099a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:20.846540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1e4d-dc7f-4233-834c-51af65099a60 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:20.847279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c1e4d-dc7f-4233-834c-51af65099a60 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:20.847580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c1e4d-dc7f-4233-834c-51af65099a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:20.848971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c1e4d-dc7f-4233-834c-51af65099a60 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:20.854385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 482/959] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:20.860102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:20.866775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:20.979960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a2a3f-eb9f-482b-9f3e-5bad5e8415aa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:21.015305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf18a3-d502-49d7-a31f-19ad1c7d5a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:21.015981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf18a3-d502-49d7-a31f-19ad1c7d5a7d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:21.016261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf18a3-d502-49d7-a31f-19ad1c7d5a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:21.016534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf18a3-d502-49d7-a31f-19ad1c7d5a7d None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:21.017246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf18a3-d502-49d7-a31f-19ad1c7d5a7d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:21.017550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf18a3-d502-49d7-a31f-19ad1c7d5a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:21.018949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf18a3-d502-49d7-a31f-19ad1c7d5a7d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:21.023927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 478/960] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:21.752077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77675e-fcff-4742-9b45-2790cb47e1c3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:21.752607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77675e-fcff-4742-9b45-2790cb47e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:21.752607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77675e-fcff-4742-9b45-2790cb47e1c3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:21.754292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 483/961] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:21.759570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df96d2-135b-4f45-b72d-4cf2b2477cd5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:21.759986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df96d2-135b-4f45-b72d-4cf2b2477cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:21.760155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df96d2-135b-4f45-b72d-4cf2b2477cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:21.777652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-40df96d2-135b-4f45-b72d-4cf2b2477cd5 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:21.778848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-40df96d2-135b-4f45-b72d-4cf2b2477cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:21.841225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:21.847823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 479/962] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:21.872539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77675e-fcff-4742-9b45-2790cb47e1c3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:21.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77675e-fcff-4742-9b45-2790cb47e1c3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:22.013237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77238a-0a2c-4a1e-af75-89217bb43ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:22.013979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77238a-0a2c-4a1e-af75-89217bb43ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.014255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77238a-0a2c-4a1e-af75-89217bb43ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.014525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77238a-0a2c-4a1e-af75-89217bb43ef3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.025136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77238a-0a2c-4a1e-af75-89217bb43ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8e77238a-0a2c-4a1e-af75-89217bb43ef3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:22.033327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:22.034252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:22.035117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 484/963] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jul 20 15:16:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:22.040892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df96d2-135b-4f45-b72d-4cf2b2477cd5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.147517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df96d2-135b-4f45-b72d-4cf2b2477cd5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:22.190172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acdb2b-240b-45bb-894d-96a8c8aaac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:22.190864 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdb2b-240b-45bb-894d-96a8c8aaac9e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.191173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdb2b-240b-45bb-894d-96a8c8aaac9e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.191450 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdb2b-240b-45bb-894d-96a8c8aaac9e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.192210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdb2b-240b-45bb-894d-96a8c8aaac9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:22.192515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdb2b-240b-45bb-894d-96a8c8aaac9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:22.193954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdb2b-240b-45bb-894d-96a8c8aaac9e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:22.203431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 480/964] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jul 20 15:16:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:22.208701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77238a-0a2c-4a1e-af75-89217bb43ef3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.235433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:22.263353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066f92-9f1d-4354-967d-0ac4fc3858f3 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.263548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066f92-9f1d-4354-967d-0ac4fc3858f3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.263815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066f92-9f1d-4354-967d-0ac4fc3858f3 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.265736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 481/965] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:22.270357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0acb9-285a-4609-82f6-b44f4f13a018 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.270645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0acb9-285a-4609-82f6-b44f4f13a018 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.270922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0acb9-285a-4609-82f6-b44f4f13a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.290943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-96b0acb9-285a-4609-82f6-b44f4f13a018 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:22.292781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-96b0acb9-285a-4609-82f6-b44f4f13a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:22.317246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77238a-0a2c-4a1e-af75-89217bb43ef3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:22.353506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:22.354743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.355296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.355870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.367633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:22.369382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:22.370657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:22.385896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 482/966] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:22.390134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:22.391256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:22.392177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:22.392177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:22.392177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:22.392177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:22.394134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 485/967] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:22.399927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0acb9-285a-4609-82f6-b44f4f13a018 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.415239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.503193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:22.528508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0acb9-285a-4609-82f6-b44f4f13a018 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:22.536248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21d86b-f167-45f2-9309-2bc35f70c436 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:22.565815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bf952-24f3-45b8-a81c-1b66c4c7df99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:22.566835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf952-24f3-45b8-a81c-1b66c4c7df99 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.567334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf952-24f3-45b8-a81c-1b66c4c7df99 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.567612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bf952-24f3-45b8-a81c-1b66c4c7df99 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.568409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bf952-24f3-45b8-a81c-1b66c4c7df99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:22.568717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bf952-24f3-45b8-a81c-1b66c4c7df99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:22.570126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bf952-24f3-45b8-a81c-1b66c4c7df99 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:22.575365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4ddf9-aa24-428f-aaa9-52cb6225169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:22.576026 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4ddf9-aa24-428f-aaa9-52cb6225169c None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.576305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4ddf9-aa24-428f-aaa9-52cb6225169c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.576579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4ddf9-aa24-428f-aaa9-52cb6225169c None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.577339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4ddf9-aa24-428f-aaa9-52cb6225169c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:22.578704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4ddf9-aa24-428f-aaa9-52cb6225169c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:22.586551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 483/968] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:22.588005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5825-cf95-4f4d-bd77-ae45c1fbb8c9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.588293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5825-cf95-4f4d-bd77-ae45c1fbb8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.588576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5825-cf95-4f4d-bd77-ae45c1fbb8c9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.589914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 484/969] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:22.590768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5825-cf95-4f4d-bd77-ae45c1fbb8c9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.595444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.sql.core [None req-ded4ddf9-aa24-428f-aaa9-52cb6225169c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 15:16:22.595444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 15:16:22.595444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [parameters: {'user_id': 'b94aadc4c3b7489f834c9ccd887e8e57', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 15:16:22.595444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80224) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ded4ddf9-aa24-428f-aaa9-52cb6225169c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 20 15:16:22.603361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:16:22.604324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application yield resource Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise self.value Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application session.commit() Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 15:16:22.610539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.session.flush() Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application compat.raise_( Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 15:16:22.611768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:16:22.612742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application result.read() Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:16:22.615807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b94aadc4c3b7489f834c9ccd887e8e57', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:22.617737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 15:16:22.620438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 486/970] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jul 20 15:16:22 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856f750-46fa-47c8-b02f-25ebe695709b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856f750-46fa-47c8-b02f-25ebe695709b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.623517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856f750-46fa-47c8-b02f-25ebe695709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.626412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6856f750-46fa-47c8-b02f-25ebe695709b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:22.627979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6856f750-46fa-47c8-b02f-25ebe695709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:22.656004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:22.698771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 487/971] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:22.699913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856f750-46fa-47c8-b02f-25ebe695709b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.721978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5825-cf95-4f4d-bd77-ae45c1fbb8c9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:22.756597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:22.757455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.757735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.757998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.765893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:22.767375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:22.768390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:22.782281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:22.783310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 485/972] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:16:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:22.784256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.811071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856f750-46fa-47c8-b02f-25ebe695709b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:22.847543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:22.848741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.848984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.849213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.857274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:22.858957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:22.874214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:22.875481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:22.876532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 488/973] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:16:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:22.877140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.893283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b31b3-9b69-4feb-980e-161eb1b8134a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:22.904829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:22.929178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:22.929996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:22.930268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:22.930537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:22.931214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:22.932622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:22.945542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:22.946587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:22.947479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 486/974] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:22.948280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:22.991453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710604-99db-4e32-b213-2ae98c95fa95 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.020303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:23.029830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.030510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.030789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.031092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.031939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:23.032244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.033759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.051925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef38af-18cd-4ab9-9c91-03d54147a4b1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.054468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 489/975] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jul 20 15:16:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:23.059752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:23.089199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.089972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.090268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.090540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.091370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:23.091671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.093093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.128272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 487/976] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jul 20 15:16:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:23.128915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:23.162453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:23.164833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2d1d-8362-4b3d-a593-ad301bf8bfb2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.203063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fc69d-91d7-4be4-9e24-dccb670637ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.203878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fc69d-91d7-4be4-9e24-dccb670637ea None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.204240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fc69d-91d7-4be4-9e24-dccb670637ea None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.204580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fc69d-91d7-4be4-9e24-dccb670637ea None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.205382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fc69d-91d7-4be4-9e24-dccb670637ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:23.205790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fc69d-91d7-4be4-9e24-dccb670637ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.207266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fc69d-91d7-4be4-9e24-dccb670637ea None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.218409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 490/977] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:23.218409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b6d9c-e37c-43df-a6a7-b086c876f176 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.218409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b6d9c-e37c-43df-a6a7-b086c876f176 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.218409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b6d9c-e37c-43df-a6a7-b086c876f176 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.218409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 491/978] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:23.219460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b6d9c-e37c-43df-a6a7-b086c876f176 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:23.254731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f726e1-548b-4298-9523-f75b5587c325 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.279634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:23.297208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f1b2-f83e-49de-bc63-c9cec9756752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.297786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f1b2-f83e-49de-bc63-c9cec9756752 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.298072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f1b2-f83e-49de-bc63-c9cec9756752 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.298342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f1b2-f83e-49de-bc63-c9cec9756752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.343880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b6d9c-e37c-43df-a6a7-b086c876f176 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.383059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0f1b2-f83e-49de-bc63-c9cec9756752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.384548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760fc0a-d8e8-41ac-a9ba-92e876407783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.384677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0f1b2-f83e-49de-bc63-c9cec9756752 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.385348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760fc0a-d8e8-41ac-a9ba-92e876407783 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.385714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760fc0a-d8e8-41ac-a9ba-92e876407783 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.386050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760fc0a-d8e8-41ac-a9ba-92e876407783 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.386827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760fc0a-d8e8-41ac-a9ba-92e876407783 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:23.387230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760fc0a-d8e8-41ac-a9ba-92e876407783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.388683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760fc0a-d8e8-41ac-a9ba-92e876407783 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.393613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 492/979] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:23.394940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb50c5-c68d-4c43-abd1-9ee8156027f5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.395259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb50c5-c68d-4c43-abd1-9ee8156027f5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.395543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb50c5-c68d-4c43-abd1-9ee8156027f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.413178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1eeb50c5-c68d-4c43-abd1-9ee8156027f5 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:23.414374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1eeb50c5-c68d-4c43-abd1-9ee8156027f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:23.415635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:23.481399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 493/980] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:23.482382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb50c5-c68d-4c43-abd1-9ee8156027f5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:23.488195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 488/981] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:23 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:23.489027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f1b2-f83e-49de-bc63-c9cec9756752 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:23.533821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:23.585103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f1b2-f83e-49de-bc63-c9cec9756752 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.589984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb50c5-c68d-4c43-abd1-9ee8156027f5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.614302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:23.620128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.620943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.621227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.621504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.626012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.626676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.626955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.627257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.628057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] RBAC: Adding query filter params (interface=admin, service_id=d8d5754e316c418e90d2f85356efb88f, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:23.628367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.629747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.631797 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.633645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.634862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 494/982] 10.222.0.47 () {56 vars in 1249 bytes} [Wed Jul 20 15:16:23 2022] GET /identity/v3/endpoints?service_id=d8d5754e316c418e90d2f85356efb88f&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:23.635645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:23.652156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:23.653313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:23.654569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:23.654569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:23.654569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:23.654569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:23.654569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 489/983] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:23.654569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:23.735742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e993a-4661-4be7-81bc-505da1de7285 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.742947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:23.754263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d373bdc-bf54-4c4e-aeb7-ae0064a55bed None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.771788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc88b63-2617-40e2-b605-311ed940bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.772539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc88b63-2617-40e2-b605-311ed940bd51 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.772763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc88b63-2617-40e2-b605-311ed940bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.773084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc88b63-2617-40e2-b605-311ed940bd51 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.773804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc88b63-2617-40e2-b605-311ed940bd51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.775248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc88b63-2617-40e2-b605-311ed940bd51 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.788608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 495/984] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:16:23 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:23.789409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc88b63-2617-40e2-b605-311ed940bd51 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:23.806444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaaeeb-5840-4e80-893f-8dcb81475b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.807250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaaeeb-5840-4e80-893f-8dcb81475b99 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.807968 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaaeeb-5840-4e80-893f-8dcb81475b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.807968 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaaeeb-5840-4e80-893f-8dcb81475b99 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.808417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaaeeb-5840-4e80-893f-8dcb81475b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.809863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaaeeb-5840-4e80-893f-8dcb81475b99 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.817525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 490/985] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:16:23 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:16:23.911294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc88b63-2617-40e2-b605-311ed940bd51 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:23.959081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:23.960053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:23.960501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:23.960832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:23.961589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:23.961924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:23.963448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:23.977369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 496/986] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:23.983266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaaeeb-5840-4e80-893f-8dcb81475b99 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:24.033827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:24.091340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaaeeb-5840-4e80-893f-8dcb81475b99 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:24.127721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:24.128629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:24.128983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:24.129322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:24.136412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:24.137959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:24.152443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:24.153601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:24.154793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:24.154793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:24.154793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:24.154793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:24.154793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:24.154793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:24.154793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:24.154793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:24.155967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 491/987] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:24.161808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:24.190675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:24.265731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad731d-b721-4af4-8372-bfeb59c942fa None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:24.302016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413989ae-49f3-4ebe-85e9-3818c45f4959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:24.302758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413989ae-49f3-4ebe-85e9-3818c45f4959 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:24.303078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413989ae-49f3-4ebe-85e9-3818c45f4959 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:24.303360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413989ae-49f3-4ebe-85e9-3818c45f4959 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:24.304167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413989ae-49f3-4ebe-85e9-3818c45f4959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:24.304478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413989ae-49f3-4ebe-85e9-3818c45f4959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:24.305935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413989ae-49f3-4ebe-85e9-3818c45f4959 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:24.318212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 497/988] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:24.324405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:24.425759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65ce6-68c3-447b-a6f9-b808c510fd4b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:24.428189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:24.460266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9ad83-438b-4394-bff5-04863102a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:24.461015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ad83-438b-4394-bff5-04863102a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:24.461362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ad83-438b-4394-bff5-04863102a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:24.461704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ad83-438b-4394-bff5-04863102a8f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:24.462609 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9ad83-438b-4394-bff5-04863102a8f0 None admin] RBAC: Adding query filter params (role.id=390c2ce1ea864379bfee5f65891dcb44, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=5cdab500d7854e69b13a16aa5946df6b) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:24.462990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9ad83-438b-4394-bff5-04863102a8f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:24.464521 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9ad83-438b-4394-bff5-04863102a8f0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:24.470780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 492/989] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:24 2022] GET /identity/v3/role_assignments?user.id=5cdab500d7854e69b13a16aa5946df6b&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=390c2ce1ea864379bfee5f65891dcb44 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:25.871595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2619-3f0d-4829-b54d-c7b295c2710d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:25.872178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2619-3f0d-4829-b54d-c7b295c2710d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:25.872178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2619-3f0d-4829-b54d-c7b295c2710d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:25.873710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 498/990] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:25.879015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a518b-676b-4a56-96dc-262cd1fc29dc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:25.879449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a518b-676b-4a56-96dc-262cd1fc29dc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:25.879629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a518b-676b-4a56-96dc-262cd1fc29dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:25.884961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b70068-c835-4760-a56c-199e0455b812 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:25.884961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b70068-c835-4760-a56c-199e0455b812 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:25.884961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b70068-c835-4760-a56c-199e0455b812 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:25.884961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 499/991] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:25.890031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818a47-786a-4e8d-b43a-78ea8cf66816 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:25.890282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818a47-786a-4e8d-b43a-78ea8cf66816 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:25.890586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818a47-786a-4e8d-b43a-78ea8cf66816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:25.899487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-057a518b-676b-4a56-96dc-262cd1fc29dc None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:25.900670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-057a518b-676b-4a56-96dc-262cd1fc29dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:25.907684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-88818a47-786a-4e8d-b43a-78ea8cf66816 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:25.908942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-88818a47-786a-4e8d-b43a-78ea8cf66816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:25.972128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 493/992] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:25.987576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 500/993] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:25.995175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a518b-676b-4a56-96dc-262cd1fc29dc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.011160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818a47-786a-4e8d-b43a-78ea8cf66816 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.030047 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:26.097932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:26.101999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a518b-676b-4a56-96dc-262cd1fc29dc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.121880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818a47-786a-4e8d-b43a-78ea8cf66816 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.138630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.139492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.139771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.140041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.140692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.142070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:26.154884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:26.156020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:26.157575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 494/994] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jul 20 15:16:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:26.159717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.160532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.160817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.161211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.161796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.161994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.163294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:26.175683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:26.176697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:26.178852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 501/995] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:26.182725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.269356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfcf55-2152-4854-b554-a459aad29ce6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.269820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:26.293349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ae93-7360-4187-9eb2-f00348ea43a2 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.306494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.307206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.307488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.307760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.308469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:26.308775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.310166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.315012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 495/996] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:26.320636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.328876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.329740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.329952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.330222 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.330928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:26.331267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.332793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.343115 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 502/997] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:26.343857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.354079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:26.435640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abc12-0f4b-4509-85ff-881a16357a43 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.465535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8a317-547d-4f46-99b3-b4aea4fe50bf None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.472430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.473535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.473816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.474089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.475271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:26.475584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.477303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.482858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 496/998] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:26.488114 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.505607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39e333-65a0-4a2b-a768-55b3775ac802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.506370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e333-65a0-4a2b-a768-55b3775ac802 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.506658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e333-65a0-4a2b-a768-55b3775ac802 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.506939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e333-65a0-4a2b-a768-55b3775ac802 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.507669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39e333-65a0-4a2b-a768-55b3775ac802 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:26.507978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39e333-65a0-4a2b-a768-55b3775ac802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.509375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39e333-65a0-4a2b-a768-55b3775ac802 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.514416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 503/999] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:26.518248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde60c7-005b-40fb-9564-61d2bbbb1c64 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.518533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde60c7-005b-40fb-9564-61d2bbbb1c64 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.518809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde60c7-005b-40fb-9564-61d2bbbb1c64 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.520363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 504/1000] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:26.520890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde60c7-005b-40fb-9564-61d2bbbb1c64 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.532007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:26.583522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:26.594034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb136b-7c84-412c-9ab9-c01218e5036a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.622272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde60c7-005b-40fb-9564-61d2bbbb1c64 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.628158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3a9b-f7ca-45f0-8ec8-5cc567aea146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.628829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3a9b-f7ca-45f0-8ec8-5cc567aea146 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.629120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3a9b-f7ca-45f0-8ec8-5cc567aea146 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.629452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3a9b-f7ca-45f0-8ec8-5cc567aea146 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.630196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad3a9b-f7ca-45f0-8ec8-5cc567aea146 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.631678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad3a9b-f7ca-45f0-8ec8-5cc567aea146 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.646206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 497/1001] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:16:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:16:26.647546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898607a-20df-4a54-9cf7-479b18442933 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.647829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898607a-20df-4a54-9cf7-479b18442933 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.648098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898607a-20df-4a54-9cf7-479b18442933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.666551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a898607a-20df-4a54-9cf7-479b18442933 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:26.668050 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a898607a-20df-4a54-9cf7-479b18442933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:26.668183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.668848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.669132 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.669401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.670219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] RBAC: Adding query filter params (interface=public, service_id=9cbd3771b2eb4733871eff04f26b54a5, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:26.670536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.672018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.683187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 505/1002] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/endpoints?service_id=9cbd3771b2eb4733871eff04f26b54a5&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:26.684443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.746596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 498/1003] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:26.756985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:26.769668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898607a-20df-4a54-9cf7-479b18442933 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:26.795100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da1b1-7c1d-4e5c-836b-9ddc632b1738 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.835149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6669c-8bb7-4eab-9d80-af5f10a31dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.836184 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6669c-8bb7-4eab-9d80-af5f10a31dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.836299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6669c-8bb7-4eab-9d80-af5f10a31dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.836530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6669c-8bb7-4eab-9d80-af5f10a31dc0 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.837221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6669c-8bb7-4eab-9d80-af5f10a31dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.838625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6669c-8bb7-4eab-9d80-af5f10a31dc0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.845183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 506/1004] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:16:26.865816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:26.889222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898607a-20df-4a54-9cf7-479b18442933 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:26.927966 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:26.928788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:26.929068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:26.929331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] PATH_INFO: `/v3/services/image` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:26.929998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:26.931465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:26.944605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:26.945688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:26.946574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:26.951304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 499/1005] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:26.952385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6669c-8bb7-4eab-9d80-af5f10a31dc0 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:27.064939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6669c-8bb7-4eab-9d80-af5f10a31dc0 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:27.094621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:27.100239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9459-ea32-4ab0-81bd-ecf838ac80c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:27.101317 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9459-ea32-4ab0-81bd-ecf838ac80c2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:27.101985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9459-ea32-4ab0-81bd-ecf838ac80c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:27.102255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9459-ea32-4ab0-81bd-ecf838ac80c2 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:27.102958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f9459-ea32-4ab0-81bd-ecf838ac80c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:27.103288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f9459-ea32-4ab0-81bd-ecf838ac80c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:27.104837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f9459-ea32-4ab0-81bd-ecf838ac80c2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:27.114824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 507/1006] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:27.116359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:27.221609 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5dff1-f216-41d6-8a8d-ded2ebefd62a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:27.255909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd70193-e206-4fdd-bb13-70f8ef12a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:27.256578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70193-e206-4fdd-bb13-70f8ef12a57f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:27.256850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70193-e206-4fdd-bb13-70f8ef12a57f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:27.257117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70193-e206-4fdd-bb13-70f8ef12a57f None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:27.257927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd70193-e206-4fdd-bb13-70f8ef12a57f None admin] RBAC: Adding query filter params (type=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:27.258228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd70193-e206-4fdd-bb13-70f8ef12a57f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:27.260457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd70193-e206-4fdd-bb13-70f8ef12a57f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:27.266876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 500/1007] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:28.698544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8cd3-48cd-4964-a1ea-18789e8dd6e0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:28.699162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8cd3-48cd-4964-a1ea-18789e8dd6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:28.699162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8cd3-48cd-4964-a1ea-18789e8dd6e0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:28.700660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 508/1008] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:28.705885 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951cb05-68eb-4719-bc82-ae72d2d1b2f4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:28.706303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951cb05-68eb-4719-bc82-ae72d2d1b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:28.706379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951cb05-68eb-4719-bc82-ae72d2d1b2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:28.724033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d951cb05-68eb-4719-bc82-ae72d2d1b2f4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:28.725337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d951cb05-68eb-4719-bc82-ae72d2d1b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:28.727419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:28.799189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 501/1009] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:28.822866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f8cd3-48cd-4964-a1ea-18789e8dd6e0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:28.871447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fa7b6-3a4a-4aca-98a8-b443f2b9fc32 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:28.871787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fa7b6-3a4a-4aca-98a8-b443f2b9fc32 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:28.871998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fa7b6-3a4a-4aca-98a8-b443f2b9fc32 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:28.873607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 502/1010] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:28.878395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70918-419a-46ee-8142-ea05df395067 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:28.878661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70918-419a-46ee-8142-ea05df395067 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:28.878936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70918-419a-46ee-8142-ea05df395067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:28.896399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-01e70918-419a-46ee-8142-ea05df395067 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:28.897599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-01e70918-419a-46ee-8142-ea05df395067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:28.935158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f8cd3-48cd-4964-a1ea-18789e8dd6e0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:28.971683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca5323-39d5-4c51-a47f-6e9f004ae269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:28.972496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5323-39d5-4c51-a47f-6e9f004ae269 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:28.972742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5323-39d5-4c51-a47f-6e9f004ae269 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:28.973042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca5323-39d5-4c51-a47f-6e9f004ae269 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:28.974224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca5323-39d5-4c51-a47f-6e9f004ae269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:28.975760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca5323-39d5-4c51-a47f-6e9f004ae269 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:28.977413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 509/1011] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:28.983117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca5323-39d5-4c51-a47f-6e9f004ae269 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:28.984379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 503/1012] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:29.008448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e70918-419a-46ee-8142-ea05df395067 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:29.048722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:29.085882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:29.090321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca5323-39d5-4c51-a47f-6e9f004ae269 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:29.120037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e70918-419a-46ee-8142-ea05df395067 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:29.126467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ea650-578a-40e2-af4e-fe5e73d942b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:29.127183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ea650-578a-40e2-af4e-fe5e73d942b3 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:29.127870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ea650-578a-40e2-af4e-fe5e73d942b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:29.128154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ea650-578a-40e2-af4e-fe5e73d942b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:29.128870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ea650-578a-40e2-af4e-fe5e73d942b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:29.131045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ea650-578a-40e2-af4e-fe5e73d942b3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:29.155063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9490-aa79-4b23-a56c-1964146c63fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:29.156160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9490-aa79-4b23-a56c-1964146c63fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:29.156445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9490-aa79-4b23-a56c-1964146c63fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:29.156715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9490-aa79-4b23-a56c-1964146c63fd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:29.157376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f9490-aa79-4b23-a56c-1964146c63fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:29.158757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f9490-aa79-4b23-a56c-1964146c63fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:29.171119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 510/1013] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:16:28 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e80f9490-aa79-4b23-a56c-1964146c63fd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:29.184048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:29.185238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:29.186221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 504/1014] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:29.192177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ea650-578a-40e2-af4e-fe5e73d942b3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:29.295814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414343-ddb2-40d8-af79-f7bfef11a5d9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:29.296016 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414343-ddb2-40d8-af79-f7bfef11a5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:29.296242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414343-ddb2-40d8-af79-f7bfef11a5d9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:29.297831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 505/1015] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:29.301446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ea650-578a-40e2-af4e-fe5e73d942b3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:29.303502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faffee2-2746-4fce-84c3-f9d82c0ccab8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:29.303862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faffee2-2746-4fce-84c3-f9d82c0ccab8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:29.304205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faffee2-2746-4fce-84c3-f9d82c0ccab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:29.322100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2faffee2-2746-4fce-84c3-f9d82c0ccab8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:29.322790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:29.323560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2faffee2-2746-4fce-84c3-f9d82c0ccab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:29.346934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:29.347639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:29.347923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:29.348217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:29.348957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:29.349263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:29.350917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:29.357201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 511/1016] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:29.363551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:29.404070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 506/1017] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:29.427019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faffee2-2746-4fce-84c3-f9d82c0ccab8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:29.469234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae126c-e35b-4c86-b6e6-f7673603e5a9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:29.493360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:29.510997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:29.511766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:29.512114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:29.512456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:29.513236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:29.513610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:29.515091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:29.524812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 512/1018] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jul 20 15:16:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:29.525829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:29.538154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faffee2-2746-4fce-84c3-f9d82c0ccab8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:29.572167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:29.577206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ded91d-9940-42da-92ae-f385eebeb2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:29.577873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ded91d-9940-42da-92ae-f385eebeb2a9 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:29.578154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ded91d-9940-42da-92ae-f385eebeb2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:29.578428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ded91d-9940-42da-92ae-f385eebeb2a9 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:29.579182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ded91d-9940-42da-92ae-f385eebeb2a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:29.580820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ded91d-9940-42da-92ae-f385eebeb2a9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:29.596616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 507/1019] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:16:29 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:16:29.636634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f8732-45e9-43bd-92b9-e28f0f28ec1d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:29.691101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c51ee2-9885-4e1a-a3d3-80778e3788e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:29.691874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c51ee2-9885-4e1a-a3d3-80778e3788e1 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:29.692223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c51ee2-9885-4e1a-a3d3-80778e3788e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:29.692558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c51ee2-9885-4e1a-a3d3-80778e3788e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:29.693434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c51ee2-9885-4e1a-a3d3-80778e3788e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:29.695020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c51ee2-9885-4e1a-a3d3-80778e3788e1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:29.726999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 513/1020] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:16:29 2022] POST /identity/v3/endpoints => generated 334 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:16:31.266800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ee20-f992-48fa-89f0-42cfaca59185 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.267368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ee20-f992-48fa-89f0-42cfaca59185 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.267368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208ee20-f992-48fa-89f0-42cfaca59185 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.268635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 508/1021] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:31.274405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f339-9430-47d5-b59d-65c9ca19f99c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.274875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f339-9430-47d5-b59d-65c9ca19f99c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.274953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f339-9430-47d5-b59d-65c9ca19f99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.292424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6f91f339-9430-47d5-b59d-65c9ca19f99c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:31.293658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6f91f339-9430-47d5-b59d-65c9ca19f99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:31.372164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 514/1022] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:31.396782 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208ee20-f992-48fa-89f0-42cfaca59185 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:31.502216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208ee20-f992-48fa-89f0-42cfaca59185 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:31.525910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:31.539591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993ee4c-f6ed-48f4-9649-6ccaadb1fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:31.540409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ee4c-f6ed-48f4-9649-6ccaadb1fb6a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.540689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ee4c-f6ed-48f4-9649-6ccaadb1fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.540961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ee4c-f6ed-48f4-9649-6ccaadb1fb6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.542158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993ee4c-f6ed-48f4-9649-6ccaadb1fb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:31.543672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993ee4c-f6ed-48f4-9649-6ccaadb1fb6a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:31.545534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 509/1023] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:31.551195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f339-9430-47d5-b59d-65c9ca19f99c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:31.578878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:31.656949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f339-9430-47d5-b59d-65c9ca19f99c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:31.662337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13678d6d-7b55-4705-8878-0ad3d3d1382c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.662623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13678d6d-7b55-4705-8878-0ad3d3d1382c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.662898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13678d6d-7b55-4705-8878-0ad3d3d1382c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.664463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 510/1024] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:31.669474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de3e4-e000-4988-89b2-82fa544b7730 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.669610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de3e4-e000-4988-89b2-82fa544b7730 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.669848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de3e4-e000-4988-89b2-82fa544b7730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.687874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-920de3e4-e000-4988-89b2-82fa544b7730 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:31.689082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-920de3e4-e000-4988-89b2-82fa544b7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:31.695889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea4cd-fbe7-4632-8c5c-9c18ae9e879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:31.696574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea4cd-fbe7-4632-8c5c-9c18ae9e879d None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.696854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea4cd-fbe7-4632-8c5c-9c18ae9e879d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.697556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea4cd-fbe7-4632-8c5c-9c18ae9e879d None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.698281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ea4cd-fbe7-4632-8c5c-9c18ae9e879d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:31.700141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ea4cd-fbe7-4632-8c5c-9c18ae9e879d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:31.730999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 515/1025] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:16:31 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:31.774339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 511/1026] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:31.797931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea4cd-fbe7-4632-8c5c-9c18ae9e879d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:31.858369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae8a0-475c-435e-ac52-189130dd5ed8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.858644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae8a0-475c-435e-ac52-189130dd5ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.858923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae8a0-475c-435e-ac52-189130dd5ed8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.860482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 512/1027] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:31.865976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84281226-c826-4519-ac77-91bce39d6117 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.866268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84281226-c826-4519-ac77-91bce39d6117 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.866535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84281226-c826-4519-ac77-91bce39d6117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.884414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-84281226-c826-4519-ac77-91bce39d6117 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:31.885612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-84281226-c826-4519-ac77-91bce39d6117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:31.890314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:31.921149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea4cd-fbe7-4632-8c5c-9c18ae9e879d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:31.969945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:31.970854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:31.971207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:31.971481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] PATH_INFO: `/v3/services/image` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:31.972140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:31.972941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 513/1028] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:31.973573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:31.985898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:31.986927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:31.987899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 516/1029] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Jul 20 15:16:31 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:31.995878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84281226-c826-4519-ac77-91bce39d6117 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:31.997986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:32.054167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:32.109566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84281226-c826-4519-ac77-91bce39d6117 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.113047 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ac0d4-7111-4cdd-be29-2359626d7f2f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.145942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.146745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.147058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.147426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.148033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] RBAC: Adding query filter params (name=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:32.148339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:32.149724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:32.153035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734d447-92f2-4f04-86af-8f4f28c2a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.153771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734d447-92f2-4f04-86af-8f4f28c2a2cc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.154053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734d447-92f2-4f04-86af-8f4f28c2a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.154328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734d447-92f2-4f04-86af-8f4f28c2a2cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.155073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 514/1030] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:32.160857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:32.166680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734d447-92f2-4f04-86af-8f4f28c2a2cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-4734d447-92f2-4f04-86af-8f4f28c2a2cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:32.175173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:32.176125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:32.177020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:32.179313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 517/1031] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jul 20 15:16:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:32.182346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734d447-92f2-4f04-86af-8f4f28c2a2cc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:32.185900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:32.268504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e3692-fa84-4521-b68e-5982d5b1938b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.284833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:32.297111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734d447-92f2-4f04-86af-8f4f28c2a2cc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.308549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.309308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.309586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.309853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.310555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] RBAC: Adding query filter params (type=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:32.310855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:32.312299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:32.317371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 515/1032] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:32.323596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:32.332931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.333754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.334021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.334296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.335085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:32.335403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:32.336834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:32.346407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 518/1033] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jul 20 15:16:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:32.351786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:32.416708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:32.427971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e5979-a20f-490e-a482-5bd3a4356a8d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.460553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22223b-a57a-4ac1-930a-fbb2246e0316 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.465973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.466653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.466925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.467221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.468021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] RBAC: Adding query filter params (interface=public, service_id=7514469824064297823f4fbcb2db103e, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:32.468331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:32.469817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:32.480149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 516/1034] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jul 20 15:16:32 2022] GET /identity/v3/endpoints?service_id=7514469824064297823f4fbcb2db103e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:32.481682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:32.499518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.500639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.501170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.501405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.514270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:32.515788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:32.529340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:32.533820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:32.534914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:32.535907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:32.535907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:32.535907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:32.535907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:32.535907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 519/1035] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:32.540904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:32.594231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82adfb-96e0-481e-a616-3ded348cb033 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.631481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d4478-78d4-42c8-991f-02199c20110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.632146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4478-78d4-42c8-991f-02199c20110c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.632419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4478-78d4-42c8-991f-02199c20110c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.632687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d4478-78d4-42c8-991f-02199c20110c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.633478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d4478-78d4-42c8-991f-02199c20110c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:32.634857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d4478-78d4-42c8-991f-02199c20110c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:32.642213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 517/1036] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:16:32 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:16:32.645954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3cab7-1fee-4950-ae29-e0ceb2e51129 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.666019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:32.688261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.688949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.689233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.689508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.690258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:32.690564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:32.692074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:32.707228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 520/1037] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:32.713171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d4478-78d4-42c8-991f-02199c20110c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:32.822562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d4478-78d4-42c8-991f-02199c20110c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:32.830189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:32.857271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:32.857998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:32.858280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:32.858560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:32.866020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:32.867518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:32.882958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:32.883991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:32.884965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 518/1038] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:16:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:32.890366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:33.006149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5d97-328f-4197-943f-67c30a10751c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:33.041445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:33.042129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:33.042403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:33.042681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:33.043550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:33.043856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:33.045335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:33.063735 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 521/1039] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:16:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:33.069494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:33.175200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675d95-0f44-421c-bda3-1460762d1c50 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:33.210707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2f70-b837-420d-85cd-6bbe6fa06737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:33.211390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2f70-b837-420d-85cd-6bbe6fa06737 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:33.211675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2f70-b837-420d-85cd-6bbe6fa06737 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:33.211950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2f70-b837-420d-85cd-6bbe6fa06737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:33.245933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:33.281923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd2f70-b837-420d-85cd-6bbe6fa06737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:33.283429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd2f70-b837-420d-85cd-6bbe6fa06737 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:33.382704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 519/1040] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:33.388427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:33.424274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:33.494562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eecca5-df84-4c51-ab1d-d1fe5232eaae None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:33.529949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:33.530762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:33.531078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:33.531357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:33.541761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:33.545235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:33.562343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:33.563331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:33.569121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:33.569121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:33.569121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:33.569121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:33.569121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 522/1041] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:33.570719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2f70-b837-420d-85cd-6bbe6fa06737 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:33.641669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:33.679139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2f70-b837-420d-85cd-6bbe6fa06737 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:33.713779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b5da5-61e2-477d-8c52-952c4eefd537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:33.714457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5da5-61e2-477d-8c52-952c4eefd537 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:33.714734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5da5-61e2-477d-8c52-952c4eefd537 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:33.715038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5da5-61e2-477d-8c52-952c4eefd537 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:33.715767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b5da5-61e2-477d-8c52-952c4eefd537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:33.716062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b5da5-61e2-477d-8c52-952c4eefd537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:33.717447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b5da5-61e2-477d-8c52-952c4eefd537 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:33.729307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 520/1042] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:33.734864 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:33.823234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:33.828880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf9fc-44e6-4505-9cba-ebd842340c9a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:33.829172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf9fc-44e6-4505-9cba-ebd842340c9a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:33.829446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdf9fc-44e6-4505-9cba-ebd842340c9a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:33.830982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 521/1043] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:33.836172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd41b-fc7d-483c-b11f-31cb7dd2b35f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:33.836456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd41b-fc7d-483c-b11f-31cb7dd2b35f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:33.836727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd41b-fc7d-483c-b11f-31cb7dd2b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:33.841302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f84d0-ee6a-434c-b397-299c546ff37e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:33.854160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-878cd41b-fc7d-483c-b11f-31cb7dd2b35f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:33.855379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-878cd41b-fc7d-483c-b11f-31cb7dd2b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:33.877782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:33.878588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:33.878852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:33.879152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:33.886223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:33.887742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:33.901763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:33.902925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:33.904077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 523/1044] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:33.908963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:33.932759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 522/1045] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:33.964033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd41b-fc7d-483c-b11f-31cb7dd2b35f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:34.021805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e24346-0eab-4531-856e-0c9f8a38c335 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:34.023873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:34.057465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:34.058129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.058412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.058688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.059515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:34.059845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:34.061277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:34.073600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 524/1046] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:34.079301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd41b-fc7d-483c-b11f-31cb7dd2b35f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:34.079598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:34.089117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:34.118637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942f0c9-f957-4135-a853-50f5a228719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:34.119511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942f0c9-f957-4135-a853-50f5a228719c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.120200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942f0c9-f957-4135-a853-50f5a228719c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.120429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942f0c9-f957-4135-a853-50f5a228719c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.131197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942f0c9-f957-4135-a853-50f5a228719c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5942f0c9-f957-4135-a853-50f5a228719c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:34.138923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:34.139874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:34.140729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 523/1047] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:16:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:34.146144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942f0c9-f957-4135-a853-50f5a228719c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:34.203643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cad8a-486f-4de8-b757-8ea4713f52f7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:34.239779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:34.240529 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.240780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.241054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.241886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] RBAC: Adding query filter params (role.id=390c2ce1ea864379bfee5f65891dcb44, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=29c52f8ffcc34046ac3ade9723bf8b89) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:34.242196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:34.243673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:34.250265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 525/1048] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:34 2022] GET /identity/v3/role_assignments?user.id=29c52f8ffcc34046ac3ade9723bf8b89&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=390c2ce1ea864379bfee5f65891dcb44 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:34.251746 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942f0c9-f957-4135-a853-50f5a228719c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:34.270729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:34.292674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:34.293346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.293629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.293917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.294686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:34.295025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:34.296427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:34.306837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 524/1049] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:34.312902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:34.392446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:34.428323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cca8-fa28-41b4-bf72-53f71d367123 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:34.464312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90778aa2-5159-4fc0-801a-5f72c5ee5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:34.465203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90778aa2-5159-4fc0-801a-5f72c5ee5f91 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.465485 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90778aa2-5159-4fc0-801a-5f72c5ee5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.465762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90778aa2-5159-4fc0-801a-5f72c5ee5f91 None admin] PATH_INFO: `/v3/users/eee32e13e73d46329a5ce04acb548f86` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.479901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90778aa2-5159-4fc0-801a-5f72c5ee5f91 None admin] RBAC: Authorizing `identity:get_user(user_id=eee32e13e73d46329a5ce04acb548f86)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:34.481381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90778aa2-5159-4fc0-801a-5f72c5ee5f91 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:34.483292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 526/1050] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:34 2022] GET /identity/v3/users/eee32e13e73d46329a5ce04acb548f86 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:34.488969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:34.595321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026634d-2b7d-44a0-843f-52f4c31b77f8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:34.631437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55fa6-5ec6-4e3f-83e6-f06cdff3ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:34.632100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55fa6-5ec6-4e3f-83e6-f06cdff3ebaf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.632370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55fa6-5ec6-4e3f-83e6-f06cdff3ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.632645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55fa6-5ec6-4e3f-83e6-f06cdff3ebaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.680883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:34.700903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e113-5ae6-4cf4-90a2-ec7d85cbd1e7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.701186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e113-5ae6-4cf4-90a2-ec7d85cbd1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.701458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e113-5ae6-4cf4-90a2-ec7d85cbd1e7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.702852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 527/1051] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:34.709051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e4dee-95ca-4c4e-8600-5a84fa05f40b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.709816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e4dee-95ca-4c4e-8600-5a84fa05f40b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.710110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e4dee-95ca-4c4e-8600-5a84fa05f40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.711777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c55fa6-5ec6-4e3f-83e6-f06cdff3ebaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:34.713238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c55fa6-5ec6-4e3f-83e6-f06cdff3ebaf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:34.728826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-030e4dee-95ca-4c4e-8600-5a84fa05f40b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:34.730667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-030e4dee-95ca-4c4e-8600-5a84fa05f40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:34.811307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 528/1052] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:34.823650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 525/1053] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:34.825177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e4dee-95ca-4c4e-8600-5a84fa05f40b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:34.834329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55fa6-5ec6-4e3f-83e6-f06cdff3ebaf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:34.891733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:34.918771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:34.934599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e4dee-95ca-4c4e-8600-5a84fa05f40b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:34.947288 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55fa6-5ec6-4e3f-83e6-f06cdff3ebaf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:34.971541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266435d-5ea5-4c1e-a1a1-6ada389c3f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:34.972425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266435d-5ea5-4c1e-a1a1-6ada389c3f9d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.972695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266435d-5ea5-4c1e-a1a1-6ada389c3f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.972969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266435d-5ea5-4c1e-a1a1-6ada389c3f9d None admin] PATH_INFO: `/v3/projects/c04572364c8a4004b0e79289ab7ddb86` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.974280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266435d-5ea5-4c1e-a1a1-6ada389c3f9d None admin] RBAC: Authorizing `identity:get_project(project_id=c04572364c8a4004b0e79289ab7ddb86)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:34.975779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266435d-5ea5-4c1e-a1a1-6ada389c3f9d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:34.977497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 529/1054] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:16:34 2022] GET /identity/v3/projects/c04572364c8a4004b0e79289ab7ddb86 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:34.983562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266435d-5ea5-4c1e-a1a1-6ada389c3f9d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:34.988741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:34.989546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:34.989849 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:34.990160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] PATH_INFO: `/v3/services/image` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:34.990816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:34.992226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:35.004354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:35.005339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:35.007911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 526/1055] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Jul 20 15:16:34 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:35.011608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:35.088031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266435d-5ea5-4c1e-a1a1-6ada389c3f9d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:35.113362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:35.118469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a1de-41f6-48b0-bd5d-366ba4dce829 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:35.124720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:35.125381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:35.125660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:35.126257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:35.126759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c04572364c8a4004b0e79289ab7ddb86, user.id=eee32e13e73d46329a5ce04acb548f86) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:35.127098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:35.128543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:35.143015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 530/1056] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:34 2022] GET /identity/v3/role_assignments?user.id=eee32e13e73d46329a5ce04acb548f86&scope.project.id=c04572364c8a4004b0e79289ab7ddb86&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:35.167058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:35.167871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:35.168217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:35.168558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:35.169366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:35.169739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:35.171276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:35.177361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 527/1057] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:35.183111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:35.296657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b287a-a3ee-4d8f-9b05-9bb1e37776bb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:35.331480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27502625-a215-4298-9eb9-c25a960b0cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:35.332170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502625-a215-4298-9eb9-c25a960b0cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:35.332450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502625-a215-4298-9eb9-c25a960b0cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:35.332728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502625-a215-4298-9eb9-c25a960b0cc7 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:35.333463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27502625-a215-4298-9eb9-c25a960b0cc7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:35.333817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27502625-a215-4298-9eb9-c25a960b0cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:35.336327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27502625-a215-4298-9eb9-c25a960b0cc7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:35.343423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 531/1058] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:35.349633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:35.360073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:35.453004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec9983-da30-4b65-834e-79ce464a1de9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:35.486761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da5304-b1f1-4c70-a5f6-3ed3214855c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:35.487458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da5304-b1f1-4c70-a5f6-3ed3214855c4 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:35.487738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da5304-b1f1-4c70-a5f6-3ed3214855c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:35.488010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da5304-b1f1-4c70-a5f6-3ed3214855c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:35.488781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da5304-b1f1-4c70-a5f6-3ed3214855c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:35.490211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da5304-b1f1-4c70-a5f6-3ed3214855c4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:35.512259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 528/1059] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:16:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:16:36.256788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b141-fdd2-4a2a-b32b-3d4aafd8c4ad None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:36.257346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b141-fdd2-4a2a-b32b-3d4aafd8c4ad None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:36.257346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b141-fdd2-4a2a-b32b-3d4aafd8c4ad None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:36.258776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 532/1060] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:36.264322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4af26-c311-4627-807d-30761bc73e31 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:36.264600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4af26-c311-4627-807d-30761bc73e31 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:36.264874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4af26-c311-4627-807d-30761bc73e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:36.282311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-eea4af26-c311-4627-807d-30761bc73e31 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:36.283516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eea4af26-c311-4627-807d-30761bc73e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:36.342511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:36.360702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 529/1061] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:36.383516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b141-fdd2-4a2a-b32b-3d4aafd8c4ad None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:36.441108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:36.487518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b141-fdd2-4a2a-b32b-3d4aafd8c4ad None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:36.525089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7eb9-e50d-41a7-896a-0e9db8813698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:36.525832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7eb9-e50d-41a7-896a-0e9db8813698 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:36.526122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7eb9-e50d-41a7-896a-0e9db8813698 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:36.526554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7eb9-e50d-41a7-896a-0e9db8813698 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:36.536712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7eb9-e50d-41a7-896a-0e9db8813698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-450f7eb9-e50d-41a7-896a-0e9db8813698 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:36.545139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:36.546067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:36.546905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:36.551344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 533/1062] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jul 20 15:16:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:36.552604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4af26-c311-4627-807d-30761bc73e31 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:36.664492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4af26-c311-4627-807d-30761bc73e31 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:36.699193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:36.699884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:36.700158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:36.700425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:36.701174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:36.701477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:36.702866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:36.716350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 530/1063] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jul 20 15:16:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:36.717798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7eb9-e50d-41a7-896a-0e9db8813698 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:36.819367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7eb9-e50d-41a7-896a-0e9db8813698 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:36.833294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:36.854775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:36.855630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:36.855905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:36.856172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:36.866843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:36.868331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:36.886353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:36.887422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:36.888323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:36.888323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:36.888323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:36.888323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:36.891339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 534/1064] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:36.895810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:36.956250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:37.008951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf5d17-2928-44a8-96a4-7d5db7684ace None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.042815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773588b5-a906-411b-a697-ac6a57367514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.043518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773588b5-a906-411b-a697-ac6a57367514 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.043813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773588b5-a906-411b-a697-ac6a57367514 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.044048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773588b5-a906-411b-a697-ac6a57367514 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.044774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773588b5-a906-411b-a697-ac6a57367514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:37.045075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773588b5-a906-411b-a697-ac6a57367514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:37.046505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773588b5-a906-411b-a697-ac6a57367514 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:37.063491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 531/1065] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:37.064814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.169946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4b9aa-3390-4d7a-94ab-cb5879ed5fa4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.186390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa89bf-2ade-4ff3-95ab-67c31a7b3b09 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.186674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa89bf-2ade-4ff3-95ab-67c31a7b3b09 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.186917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa89bf-2ade-4ff3-95ab-67c31a7b3b09 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.188486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 532/1066] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:16:37.193593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975370-0d12-4d05-9063-baf123de7928 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.193867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975370-0d12-4d05-9063-baf123de7928 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.194186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea975370-0d12-4d05-9063-baf123de7928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.210693 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ea975370-0d12-4d05-9063-baf123de7928 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:37.211914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ea975370-0d12-4d05-9063-baf123de7928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:37.212206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.213017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.213296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.213569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.221478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:37.222935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:37.241006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:37.242008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:37.243811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 535/1067] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:37.248337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.278251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:37.287018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 533/1068] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:16:37.307320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea975370-0d12-4d05-9063-baf123de7928 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.349285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:37.354234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c31ac-0a36-44bb-8251-0ab404011d38 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.389405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.390080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.390357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.390625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.391520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:37.391823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:37.393261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:37.411692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 536/1069] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:37.417279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.417412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea975370-0d12-4d05-9063-baf123de7928 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.453162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d003e-3410-4f14-9fbd-3959d1e56e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.453976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d003e-3410-4f14-9fbd-3959d1e56e24 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.454253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d003e-3410-4f14-9fbd-3959d1e56e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.454523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d003e-3410-4f14-9fbd-3959d1e56e24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.465063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d003e-3410-4f14-9fbd-3959d1e56e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6b6d003e-3410-4f14-9fbd-3959d1e56e24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:37.472803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:37.473910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:37.474940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 534/1070] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:37.480302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d003e-3410-4f14-9fbd-3959d1e56e24 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.511712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:37.528112 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb1028-bd45-48d5-8761-36ee8e21696f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.563632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a05471-67e4-4ef6-a52d-52fb483029b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.564435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05471-67e4-4ef6-a52d-52fb483029b3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.564710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05471-67e4-4ef6-a52d-52fb483029b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.564977 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05471-67e4-4ef6-a52d-52fb483029b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.577367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a05471-67e4-4ef6-a52d-52fb483029b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:37.578842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a05471-67e4-4ef6-a52d-52fb483029b3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:37.588892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:37.592142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d003e-3410-4f14-9fbd-3959d1e56e24 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-88a05471-67e4-4ef6-a52d-52fb483029b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:37.596435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:37.597503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:37.598463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:37.598463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:37.598463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:37.598463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:37.598463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 537/1071] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:37.599217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec5074-47c6-49a9-850d-ac57042f3f86 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.599536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec5074-47c6-49a9-850d-ac57042f3f86 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.599813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec5074-47c6-49a9-850d-ac57042f3f86 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.601197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 538/1072] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:37.603213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec5074-47c6-49a9-850d-ac57042f3f86 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.627798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d39651-77fb-495f-ad27-6f31104d49f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.628474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d39651-77fb-495f-ad27-6f31104d49f9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.628753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d39651-77fb-495f-ad27-6f31104d49f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.629023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d39651-77fb-495f-ad27-6f31104d49f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.629765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d39651-77fb-495f-ad27-6f31104d49f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:37.630069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d39651-77fb-495f-ad27-6f31104d49f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:37.631615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d39651-77fb-495f-ad27-6f31104d49f9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:37.639635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 535/1073] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:37.644901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8843910-da89-45c2-b7ed-9a295d625686 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.645183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8843910-da89-45c2-b7ed-9a295d625686 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.645457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8843910-da89-45c2-b7ed-9a295d625686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.661947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e8843910-da89-45c2-b7ed-9a295d625686 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:37.663165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e8843910-da89-45c2-b7ed-9a295d625686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:37.704189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec5074-47c6-49a9-850d-ac57042f3f86 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.729521 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 536/1074] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:37.730333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8843910-da89-45c2-b7ed-9a295d625686 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.738786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.739504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.739793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.740075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.740792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:37.741099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:37.742489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:37.745534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:37.756507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 539/1075] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:37.757191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.825185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:37.834807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8843910-da89-45c2-b7ed-9a295d625686 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.856433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492a3da-0f31-4da5-8104-652556ea064e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:37.871614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ccc6-981c-4d9f-9223-4ccc0914478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.872504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ccc6-981c-4d9f-9223-4ccc0914478f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.872786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ccc6-981c-4d9f-9223-4ccc0914478f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.873057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ccc6-981c-4d9f-9223-4ccc0914478f None admin] PATH_INFO: `/v3/users/eee32e13e73d46329a5ce04acb548f86` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.874274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ccc6-981c-4d9f-9223-4ccc0914478f None admin] RBAC: Authorizing `identity:get_user(user_id=eee32e13e73d46329a5ce04acb548f86)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:37.875764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ccc6-981c-4d9f-9223-4ccc0914478f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:37.877432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 537/1076] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/users/eee32e13e73d46329a5ce04acb548f86 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:37.878224 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ccc6-981c-4d9f-9223-4ccc0914478f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:37.892299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161518d6-0dff-44c3-bf30-9cda0fad1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:37.892955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161518d6-0dff-44c3-bf30-9cda0fad1d44 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:37.893236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161518d6-0dff-44c3-bf30-9cda0fad1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:37.893514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161518d6-0dff-44c3-bf30-9cda0fad1d44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:37.954079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:37.962264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161518d6-0dff-44c3-bf30-9cda0fad1d44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:37.964432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161518d6-0dff-44c3-bf30-9cda0fad1d44 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:37.984832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ccc6-981c-4d9f-9223-4ccc0914478f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:38.018252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:38.019083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:38.019362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:38.019637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:38.026281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:38.027757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:38.041363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:38.042309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 538/1077] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:38.043599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:38.064736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 540/1078] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:38.065262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:38.065642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161518d6-0dff-44c3-bf30-9cda0fad1d44 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:38.148786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e0ac8-4e28-4698-89a0-fca454b2802c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:38.164364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:38.170670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161518d6-0dff-44c3-bf30-9cda0fad1d44 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:38.184324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5a116-6df8-4070-a482-9f1ea6c6407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:38.185232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a116-6df8-4070-a482-9f1ea6c6407f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:38.185514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a116-6df8-4070-a482-9f1ea6c6407f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:38.185789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a116-6df8-4070-a482-9f1ea6c6407f None admin] PATH_INFO: `/v3/projects/c04572364c8a4004b0e79289ab7ddb86` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:38.186996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5a116-6df8-4070-a482-9f1ea6c6407f None admin] RBAC: Authorizing `identity:get_project(project_id=c04572364c8a4004b0e79289ab7ddb86)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:38.188471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5a116-6df8-4070-a482-9f1ea6c6407f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:38.190196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 539/1079] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:16:38 2022] GET /identity/v3/projects/c04572364c8a4004b0e79289ab7ddb86 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:38.190950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5a116-6df8-4070-a482-9f1ea6c6407f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:38.209099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:38.209751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:38.210031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:38.210300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:38.211125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:38.211432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:38.212920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:38.224346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 541/1080] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:38.225106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:38.281224 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:38.293601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5a116-6df8-4070-a482-9f1ea6c6407f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:38.327078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d4f81-32c9-4340-9a1a-b2d78933d8f6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:38.328322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:38.329128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:38.329435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:38.329678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:38.340729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:38.342174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:38.359588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:38.360641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:38.366625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:38.366625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:38.366625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:38.366625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:38.366866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778239d-18a2-4b33-9995-a95eb41556d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:38.366958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 540/1081] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:38.367059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778239d-18a2-4b33-9995-a95eb41556d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:38.367129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:38.367212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778239d-18a2-4b33-9995-a95eb41556d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:38.367212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778239d-18a2-4b33-9995-a95eb41556d8 None admin] PATH_INFO: `/v3/projects/c04572364c8a4004b0e79289ab7ddb86/users/eee32e13e73d46329a5ce04acb548f86/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:38.367212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778239d-18a2-4b33-9995-a95eb41556d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c04572364c8a4004b0e79289ab7ddb86, user_id=eee32e13e73d46329a5ce04acb548f86, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:38.367212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778239d-18a2-4b33-9995-a95eb41556d8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:38.380993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 542/1082] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:16:38 2022] PUT /identity/v3/projects/c04572364c8a4004b0e79289ab7ddb86/users/eee32e13e73d46329a5ce04acb548f86/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:16:38.381802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778239d-18a2-4b33-9995-a95eb41556d8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:38.405122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:38.476209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce1bba-23fa-4c0c-b350-c49e1bfb0282 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:38.508755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778239d-18a2-4b33-9995-a95eb41556d8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:38.512554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4b447-d025-4fbd-a0f0-24e947a9ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:38.513486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b447-d025-4fbd-a0f0-24e947a9ff86 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:38.513770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b447-d025-4fbd-a0f0-24e947a9ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:38.514047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b447-d025-4fbd-a0f0-24e947a9ff86 None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/29c52f8ffcc34046ac3ade9723bf8b89/roles/390c2ce1ea864379bfee5f65891dcb44` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:38.516403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4b447-d025-4fbd-a0f0-24e947a9ff86 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=29c52f8ffcc34046ac3ade9723bf8b89, role_id=390c2ce1ea864379bfee5f65891dcb44)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:38.517902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4b447-d025-4fbd-a0f0-24e947a9ff86 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:38.527936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:38.533073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 541/1083] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:16:38 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/29c52f8ffcc34046ac3ade9723bf8b89/roles/390c2ce1ea864379bfee5f65891dcb44 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:16:38.558699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df65096-5b52-4859-8dce-19f358c32835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:38.559426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65096-5b52-4859-8dce-19f358c32835 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:38.559714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65096-5b52-4859-8dce-19f358c32835 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:38.559990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65096-5b52-4859-8dce-19f358c32835 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:38.560745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df65096-5b52-4859-8dce-19f358c32835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:38.561060 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df65096-5b52-4859-8dce-19f358c32835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:38.562491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df65096-5b52-4859-8dce-19f358c32835 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:38.577460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 543/1084] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:40.419302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd340-8ab5-4989-a682-28258fcf7489 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:40.419835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd340-8ab5-4989-a682-28258fcf7489 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:40.419835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd340-8ab5-4989-a682-28258fcf7489 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:40.421158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 542/1085] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:40.426518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fbe1-c79f-4efe-891e-29987de8c708 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:40.426941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fbe1-c79f-4efe-891e-29987de8c708 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:40.427120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fbe1-c79f-4efe-891e-29987de8c708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:40.445228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1c82fbe1-c79f-4efe-891e-29987de8c708 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:40.446433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c82fbe1-c79f-4efe-891e-29987de8c708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:40.517487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 544/1086] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:40.544922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd340-8ab5-4989-a682-28258fcf7489 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:40.566657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3ff13-6797-42d4-a7be-efa015599490 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:40.567091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3ff13-6797-42d4-a7be-efa015599490 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:40.567369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3ff13-6797-42d4-a7be-efa015599490 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:40.568848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 545/1087] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:40.573780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39331e-e86a-480d-9b39-e871bdff2369 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:40.574066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39331e-e86a-480d-9b39-e871bdff2369 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:40.574343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39331e-e86a-480d-9b39-e871bdff2369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:40.586362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:40.592443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-df39331e-e86a-480d-9b39-e871bdff2369 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:40.593628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-df39331e-e86a-480d-9b39-e871bdff2369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:40.655959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd340-8ab5-4989-a682-28258fcf7489 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:40.665237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 546/1088] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:40.689972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39331e-e86a-480d-9b39-e871bdff2369 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:40.691672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25002d1-db96-4deb-932d-c1bc6c9eaed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:40.692489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25002d1-db96-4deb-932d-c1bc6c9eaed7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:40.692768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25002d1-db96-4deb-932d-c1bc6c9eaed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:40.693077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25002d1-db96-4deb-932d-c1bc6c9eaed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:40.703942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25002d1-db96-4deb-932d-c1bc6c9eaed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b25002d1-db96-4deb-932d-c1bc6c9eaed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:40.711620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:40.712598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:16:40.713451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 543/1089] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:16:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:40.718739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25002d1-db96-4deb-932d-c1bc6c9eaed7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:40.777878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:40.791451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39331e-e86a-480d-9b39-e871bdff2369 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:40.818550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25002d1-db96-4deb-932d-c1bc6c9eaed7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:40.824741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b45f1-78ca-44e7-bbd0-05f1889f42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:40.825563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b45f1-78ca-44e7-bbd0-05f1889f42c9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:40.825837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b45f1-78ca-44e7-bbd0-05f1889f42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:40.826103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b45f1-78ca-44e7-bbd0-05f1889f42c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:40.828720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:40.837131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b45f1-78ca-44e7-bbd0-05f1889f42c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e19b45f1-78ca-44e7-bbd0-05f1889f42c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:16:40.845340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:40.846304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:40.847215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 547/1090] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jul 20 15:16:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:40.852695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b45f1-78ca-44e7-bbd0-05f1889f42c9 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:40.854157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:40.854860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:40.855159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:40.855430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:40.856180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:40.856486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:40.857872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:40.866156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 544/1091] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:40.872537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:40.956801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b45f1-78ca-44e7-bbd0-05f1889f42c9 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:40.970340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9a2c2-0b55-4e7a-b0bd-a4257219b9c8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:40.993052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:40.993726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:40.993856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:40.994037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:40.995266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:40.996122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:40.996447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:40.997986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.007658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 548/1092] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jul 20 15:16:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:41.008212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbe561-6208-462f-a760-6b1d3d8f78ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.009795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbe561-6208-462f-a760-6b1d3d8f78ae None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.010279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbe561-6208-462f-a760-6b1d3d8f78ae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.010554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbe561-6208-462f-a760-6b1d3d8f78ae None admin] PATH_INFO: `/v3/users/eee32e13e73d46329a5ce04acb548f86` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.011909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbe561-6208-462f-a760-6b1d3d8f78ae None admin] RBAC: Authorizing `identity:get_user(user_id=eee32e13e73d46329a5ce04acb548f86)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.013393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbe561-6208-462f-a760-6b1d3d8f78ae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.014928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:41.015676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 545/1093] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:40 2022] GET /identity/v3/users/eee32e13e73d46329a5ce04acb548f86 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:41.021518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbe561-6208-462f-a760-6b1d3d8f78ae None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:41.085277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:41.125432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbe561-6208-462f-a760-6b1d3d8f78ae None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:41.127478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7134-4a32-4b54-b8b9-0ef79361b3a3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:41.160027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05815d75-0125-4a5e-af33-03920d519ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.160680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05815d75-0125-4a5e-af33-03920d519ebf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.160959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05815d75-0125-4a5e-af33-03920d519ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.161233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05815d75-0125-4a5e-af33-03920d519ebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.161760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.162565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.162848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.163157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.174069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.175607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:41.192447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:41.193518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:41.194421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:41.194421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:41.194421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:41.194421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:41.194421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 549/1094] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:16:41.199559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:41.219275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:41.230578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05815d75-0125-4a5e-af33-03920d519ebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.232087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05815d75-0125-4a5e-af33-03920d519ebf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.299666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb74a74-c8b3-47a4-ab71-4fb9cc7e5fc8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:41.309833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:41.335164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 546/1095] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:41.335843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.336209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05815d75-0125-4a5e-af33-03920d519ebf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:41.336515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.336798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.337074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.337801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:41.338113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.339765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.357039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 550/1096] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:41.358005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:41.430431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:41.440395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05815d75-0125-4a5e-af33-03920d519ebf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:41.462861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82d478-dca2-4bc6-9407-faa975b06733 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:41.475117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e8e99-3c04-491e-984a-b8f7b8b94cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.475994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e8e99-3c04-491e-984a-b8f7b8b94cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.476273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e8e99-3c04-491e-984a-b8f7b8b94cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.476552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e8e99-3c04-491e-984a-b8f7b8b94cc5 None admin] PATH_INFO: `/v3/projects/c04572364c8a4004b0e79289ab7ddb86` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.477771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e8e99-3c04-491e-984a-b8f7b8b94cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=c04572364c8a4004b0e79289ab7ddb86)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.479296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e8e99-3c04-491e-984a-b8f7b8b94cc5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.486551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 547/1097] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:16:41 2022] GET /identity/v3/projects/c04572364c8a4004b0e79289ab7ddb86 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:41.487312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e8e99-3c04-491e-984a-b8f7b8b94cc5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:41.501101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.501907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.502194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.502471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.510169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.511665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:16:41.526088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:41.527266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:41.528614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 551/1098] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jul 20 15:16:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:41.533014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:41.563021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:41.587996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e8e99-3c04-491e-984a-b8f7b8b94cc5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:41.623436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.624101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.624381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.624656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.625501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c04572364c8a4004b0e79289ab7ddb86, user.id=eee32e13e73d46329a5ce04acb548f86) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:41.625802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.627340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.633280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 548/1099] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:41 2022] GET /identity/v3/role_assignments?user.id=eee32e13e73d46329a5ce04acb548f86&scope.project.id=c04572364c8a4004b0e79289ab7ddb86&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:41.635834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f416be-3e52-48a5-a305-04b246e6356c None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:41.673935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.674632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.674911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.675215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.676077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:41.676383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.677947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.698681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 552/1100] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jul 20 15:16:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:16:41.704888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:41.733015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:41.813620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c47d1a-4d6a-44ec-aa84-3673b61cec95 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:41.847149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431ee2d-7ba7-4a05-903c-1d07aba75bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:41.847870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431ee2d-7ba7-4a05-903c-1d07aba75bad None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:41.848183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431ee2d-7ba7-4a05-903c-1d07aba75bad None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:41.848458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431ee2d-7ba7-4a05-903c-1d07aba75bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:41.915665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431ee2d-7ba7-4a05-903c-1d07aba75bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:41.917143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431ee2d-7ba7-4a05-903c-1d07aba75bad None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:41.940848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:42.021327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 549/1101] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:42.027266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:42.118954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:42.132746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd35a33-77e0-4708-8f5d-c1b6ef8a90b4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:42.166729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:42.167557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:42.167837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:42.168106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:42.178578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:42.180090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:16:42.197936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:42.198987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:42.200110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:16:42.200110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:16:42.200110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:16:42.200110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:42.203145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 553/1102] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:42.204908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431ee2d-7ba7-4a05-903c-1d07aba75bad None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:42.305716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431ee2d-7ba7-4a05-903c-1d07aba75bad None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:42.329184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:42.342382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:42.343088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:42.343398 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:42.343669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:42.344370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:42.344676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:42.346066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:42.357875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 550/1103] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:42.363576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:42.467906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1711-cca9-46e4-8854-2e6c7ab88e00 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:42.502381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:42.503202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:42.503481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:42.503757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:42.510734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:42.512226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:42.514875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:16:42.527677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:16:42.528658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:16:42.529550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 554/1104] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:16:42.534932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:42.637488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1df8-2766-490e-bb8b-f3c0c8b0c9dd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:42.673092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45773b-0791-48ea-8af1-665140e1523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:42.673756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45773b-0791-48ea-8af1-665140e1523a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:42.674038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45773b-0791-48ea-8af1-665140e1523a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:42.674300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45773b-0791-48ea-8af1-665140e1523a None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:42.675127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45773b-0791-48ea-8af1-665140e1523a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:42.675438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45773b-0791-48ea-8af1-665140e1523a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:42.676891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45773b-0791-48ea-8af1-665140e1523a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:42.688932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 551/1105] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:42.695182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:42.801004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828629a-4197-4d60-84c8-2ffccec8b139 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:42.836627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f408-27f2-4f6a-b7ed-d0ebea67084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:42.837282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f408-27f2-4f6a-b7ed-d0ebea67084a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:42.837571 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f408-27f2-4f6a-b7ed-d0ebea67084a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:42.837833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f408-27f2-4f6a-b7ed-d0ebea67084a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:42.838667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3f408-27f2-4f6a-b7ed-d0ebea67084a None admin] RBAC: Adding query filter params (role.id=390c2ce1ea864379bfee5f65891dcb44, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=29c52f8ffcc34046ac3ade9723bf8b89) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:42.838991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3f408-27f2-4f6a-b7ed-d0ebea67084a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:42.840456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3f408-27f2-4f6a-b7ed-d0ebea67084a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:42.846390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 555/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:42 2022] GET /identity/v3/role_assignments?user.id=29c52f8ffcc34046ac3ade9723bf8b89&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=390c2ce1ea864379bfee5f65891dcb44 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:43.671843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca4ed-edd6-445f-b2f5-50dd7ac48ab0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:43.672378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca4ed-edd6-445f-b2f5-50dd7ac48ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:43.672378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca4ed-edd6-445f-b2f5-50dd7ac48ab0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:43.673778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 552/1107] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:43.679482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b673-1a75-4b92-84ec-2874c24898ac None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:43.679860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b673-1a75-4b92-84ec-2874c24898ac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:43.680029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b673-1a75-4b92-84ec-2874c24898ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:43.697800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d781b673-1a75-4b92-84ec-2874c24898ac None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:43.699010 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d781b673-1a75-4b92-84ec-2874c24898ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:43.760914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:43.770347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 556/1108] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:43.795448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ca4ed-edd6-445f-b2f5-50dd7ac48ab0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:43.851369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:43.921729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ca4ed-edd6-445f-b2f5-50dd7ac48ab0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:43.960481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6b3c7-aa5f-46dd-859c-c368764aa32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:43.961281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6b3c7-aa5f-46dd-859c-c368764aa32b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:43.961559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6b3c7-aa5f-46dd-859c-c368764aa32b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:43.961827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6b3c7-aa5f-46dd-859c-c368764aa32b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:43.963084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6b3c7-aa5f-46dd-859c-c368764aa32b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:43.964539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6b3c7-aa5f-46dd-859c-c368764aa32b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:43.966170 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 553/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:43.972201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b673-1a75-4b92-84ec-2874c24898ac None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:44.074448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b673-1a75-4b92-84ec-2874c24898ac None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:44.112537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee456c5-5326-4216-8528-9f68fef86d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:44.113351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee456c5-5326-4216-8528-9f68fef86d14 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:44.113658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee456c5-5326-4216-8528-9f68fef86d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:44.113954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee456c5-5326-4216-8528-9f68fef86d14 None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:44.114863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee456c5-5326-4216-8528-9f68fef86d14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:44.116477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee456c5-5326-4216-8528-9f68fef86d14 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:44.138995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 557/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:16:43 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:46.203342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce436-74c3-4c2f-8104-4027dddbecc3 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:46.203874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce436-74c3-4c2f-8104-4027dddbecc3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:46.203874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce436-74c3-4c2f-8104-4027dddbecc3 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:46.205253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 554/1111] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:46.218325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cfc0d-46dc-469e-8b16-638212716514 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:46.219040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cfc0d-46dc-469e-8b16-638212716514 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:46.219351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cfc0d-46dc-469e-8b16-638212716514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:46.245266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-334cfc0d-46dc-469e-8b16-638212716514 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:46.246467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-334cfc0d-46dc-469e-8b16-638212716514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:46.296591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:46.319762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 558/1112] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:46.349027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce436-74c3-4c2f-8104-4027dddbecc3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:46.461498 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce436-74c3-4c2f-8104-4027dddbecc3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:46.472483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:46.510984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0fa2-7e1c-4cdb-9351-b95b416ff4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:46.511875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0fa2-7e1c-4cdb-9351-b95b416ff4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:46.512153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0fa2-7e1c-4cdb-9351-b95b416ff4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:46.512424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0fa2-7e1c-4cdb-9351-b95b416ff4d8 None admin] PATH_INFO: `/v3/roles/ad532b5de50547a7a0f952954be2d53e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:46.513957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf0fa2-7e1c-4cdb-9351-b95b416ff4d8 None admin] RBAC: Authorizing `identity:get_role(role_id=ad532b5de50547a7a0f952954be2d53e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:46.515394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf0fa2-7e1c-4cdb-9351-b95b416ff4d8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:46.516776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 555/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:46 2022] GET /identity/v3/roles/ad532b5de50547a7a0f952954be2d53e => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:46.523315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cfc0d-46dc-469e-8b16-638212716514 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:46.636946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cfc0d-46dc-469e-8b16-638212716514 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:46.673077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc483db-4c04-4df4-9153-42eef9c1fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:46.673944 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc483db-4c04-4df4-9153-42eef9c1fead None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:46.674220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc483db-4c04-4df4-9153-42eef9c1fead None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:46.674489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc483db-4c04-4df4-9153-42eef9c1fead None admin] PATH_INFO: `/v3/users/9656b9b49eef460aa099861d0c252314` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:46.688122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc483db-4c04-4df4-9153-42eef9c1fead None admin] RBAC: Authorizing `identity:get_user(user_id=9656b9b49eef460aa099861d0c252314)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:46.689583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc483db-4c04-4df4-9153-42eef9c1fead None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:46.691274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 559/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:46 2022] GET /identity/v3/users/9656b9b49eef460aa099861d0c252314 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:46.700051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0fa2-7e1c-4cdb-9351-b95b416ff4d8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:46.803519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0fa2-7e1c-4cdb-9351-b95b416ff4d8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:46.840135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc48ad1-2d73-4ef5-a29b-0252cfb8b19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:46.840767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc48ad1-2d73-4ef5-a29b-0252cfb8b19c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:46.841038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc48ad1-2d73-4ef5-a29b-0252cfb8b19c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:46.841310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc48ad1-2d73-4ef5-a29b-0252cfb8b19c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:46.887608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:46.910887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc48ad1-2d73-4ef5-a29b-0252cfb8b19c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:46.912393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc48ad1-2d73-4ef5-a29b-0252cfb8b19c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:47.013997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 556/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:47.023437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc483db-4c04-4df4-9153-42eef9c1fead None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:47.076315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:47.140601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc483db-4c04-4df4-9153-42eef9c1fead None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:47.176093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f6c1-9b98-423b-81ff-5c367eed5cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:47.176955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f6c1-9b98-423b-81ff-5c367eed5cdb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:47.177287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f6c1-9b98-423b-81ff-5c367eed5cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:47.177541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f6c1-9b98-423b-81ff-5c367eed5cdb None admin] PATH_INFO: `/v3/projects/c04572364c8a4004b0e79289ab7ddb86` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:47.178858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f6c1-9b98-423b-81ff-5c367eed5cdb None admin] RBAC: Authorizing `identity:get_project(project_id=c04572364c8a4004b0e79289ab7ddb86)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:47.180344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f6c1-9b98-423b-81ff-5c367eed5cdb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:47.182050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 560/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:16:47 2022] GET /identity/v3/projects/c04572364c8a4004b0e79289ab7ddb86 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:47.188631 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc48ad1-2d73-4ef5-a29b-0252cfb8b19c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:47.273086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:47.300671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc48ad1-2d73-4ef5-a29b-0252cfb8b19c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:47.336911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9717fab-0d93-4cce-9d02-332994733afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:47.337499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9717fab-0d93-4cce-9d02-332994733afb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:47.337773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9717fab-0d93-4cce-9d02-332994733afb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:47.338046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9717fab-0d93-4cce-9d02-332994733afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:47.338882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9717fab-0d93-4cce-9d02-332994733afb None admin] RBAC: Adding query filter params (role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=c04572364c8a4004b0e79289ab7ddb86, user.id=9656b9b49eef460aa099861d0c252314) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:47.339228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9717fab-0d93-4cce-9d02-332994733afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:47.340675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9717fab-0d93-4cce-9d02-332994733afb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:47.348194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 557/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:47 2022] GET /identity/v3/role_assignments?user.id=9656b9b49eef460aa099861d0c252314&scope.project.id=c04572364c8a4004b0e79289ab7ddb86&role.id=ad532b5de50547a7a0f952954be2d53e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:49.333817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8207-9d88-43ca-bf47-13d892f16173 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:49.334425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8207-9d88-43ca-bf47-13d892f16173 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:49.334425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8207-9d88-43ca-bf47-13d892f16173 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:49.335703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 561/1118] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:49.341858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b056-71a4-4b32-ba7f-c8eb6d3dc47d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:49.342603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b056-71a4-4b32-ba7f-c8eb6d3dc47d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:49.342789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b056-71a4-4b32-ba7f-c8eb6d3dc47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:49.368921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dac3b056-71a4-4b32-ba7f-c8eb6d3dc47d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:49.370574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dac3b056-71a4-4b32-ba7f-c8eb6d3dc47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:49.439755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 558/1119] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:49.478473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a8207-9d88-43ca-bf47-13d892f16173 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:49.595336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a8207-9d88-43ca-bf47-13d892f16173 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:49.603072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:49.635648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a1589-6e73-42ed-adea-0269f61f7802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:49.636584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a1589-6e73-42ed-adea-0269f61f7802 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:49.636862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a1589-6e73-42ed-adea-0269f61f7802 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:49.637138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a1589-6e73-42ed-adea-0269f61f7802 None admin] PATH_INFO: `/v3/roles/ad532b5de50547a7a0f952954be2d53e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:49.638640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a1589-6e73-42ed-adea-0269f61f7802 None admin] RBAC: Authorizing `identity:get_role(role_id=ad532b5de50547a7a0f952954be2d53e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:49.640072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a1589-6e73-42ed-adea-0269f61f7802 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:49.641473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 562/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:49 2022] GET /identity/v3/roles/ad532b5de50547a7a0f952954be2d53e => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:49.648251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3b056-71a4-4b32-ba7f-c8eb6d3dc47d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:49.726080 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:49.756540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3b056-71a4-4b32-ba7f-c8eb6d3dc47d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:49.792108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a157e6-4672-4207-9aad-b9438749d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:49.792982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a157e6-4672-4207-9aad-b9438749d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:49.793257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a157e6-4672-4207-9aad-b9438749d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:49.793528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a157e6-4672-4207-9aad-b9438749d3f4 None admin] PATH_INFO: `/v3/users/9656b9b49eef460aa099861d0c252314` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:49.794833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a157e6-4672-4207-9aad-b9438749d3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=9656b9b49eef460aa099861d0c252314)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:49.796311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a157e6-4672-4207-9aad-b9438749d3f4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:49.797918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 559/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:49 2022] GET /identity/v3/users/9656b9b49eef460aa099861d0c252314 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:49.803945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a1589-6e73-42ed-adea-0269f61f7802 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:49.906713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a1589-6e73-42ed-adea-0269f61f7802 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:49.954461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2519f35-38c7-43eb-b860-b6d95528047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:49.955386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519f35-38c7-43eb-b860-b6d95528047b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:49.955666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519f35-38c7-43eb-b860-b6d95528047b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:49.955937 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519f35-38c7-43eb-b860-b6d95528047b None admin] PATH_INFO: `/v3/projects/c04572364c8a4004b0e79289ab7ddb86` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:49.957356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2519f35-38c7-43eb-b860-b6d95528047b None admin] RBAC: Authorizing `identity:get_project(project_id=c04572364c8a4004b0e79289ab7ddb86)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:49.958993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2519f35-38c7-43eb-b860-b6d95528047b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:49.961037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 563/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:16:49 2022] GET /identity/v3/projects/c04572364c8a4004b0e79289ab7ddb86 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:49.967571 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a157e6-4672-4207-9aad-b9438749d3f4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:50.079896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a157e6-4672-4207-9aad-b9438749d3f4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:50.115008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e110d-d851-4ba0-ba8c-212a0e57d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:50.115919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e110d-d851-4ba0-ba8c-212a0e57d896 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:50.116198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e110d-d851-4ba0-ba8c-212a0e57d896 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:50.116471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e110d-d851-4ba0-ba8c-212a0e57d896 None admin] PATH_INFO: `/v3/projects/c04572364c8a4004b0e79289ab7ddb86/users/9656b9b49eef460aa099861d0c252314/roles/ad532b5de50547a7a0f952954be2d53e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:50.118840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e110d-d851-4ba0-ba8c-212a0e57d896 None admin] RBAC: Authorizing `identity:create_grant(project_id=c04572364c8a4004b0e79289ab7ddb86, user_id=9656b9b49eef460aa099861d0c252314, role_id=ad532b5de50547a7a0f952954be2d53e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:50.120691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e110d-d851-4ba0-ba8c-212a0e57d896 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:50.132400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:50.138228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 560/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:16:49 2022] PUT /identity/v3/projects/c04572364c8a4004b0e79289ab7ddb86/users/9656b9b49eef460aa099861d0c252314/roles/ad532b5de50547a7a0f952954be2d53e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:16:52.124948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583d1e-8d78-41be-a492-8d34c8ee4f2f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:52.125836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583d1e-8d78-41be-a492-8d34c8ee4f2f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:52.125836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b583d1e-8d78-41be-a492-8d34c8ee4f2f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:52.128042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 564/1124] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:52.136859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d415a8-ecf7-448a-8aa3-ef6d5ac1da30 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:52.137300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d415a8-ecf7-448a-8aa3-ef6d5ac1da30 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:52.137425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d415a8-ecf7-448a-8aa3-ef6d5ac1da30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:52.158858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-25d415a8-ecf7-448a-8aa3-ef6d5ac1da30 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:52.160084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-25d415a8-ecf7-448a-8aa3-ef6d5ac1da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:52.231613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 561/1125] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:52.259398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b583d1e-8d78-41be-a492-8d34c8ee4f2f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:52.318672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:52.376922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b583d1e-8d78-41be-a492-8d34c8ee4f2f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:52.412472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c4502-8df8-401d-a218-67f4158cb5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:52.413325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c4502-8df8-401d-a218-67f4158cb5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:52.413601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c4502-8df8-401d-a218-67f4158cb5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:52.413875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c4502-8df8-401d-a218-67f4158cb5a8 None admin] PATH_INFO: `/v3/roles/ad532b5de50547a7a0f952954be2d53e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:52.415499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c4502-8df8-401d-a218-67f4158cb5a8 None admin] RBAC: Authorizing `identity:get_role(role_id=ad532b5de50547a7a0f952954be2d53e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:52.416886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c4502-8df8-401d-a218-67f4158cb5a8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:52.418260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 565/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:52 2022] GET /identity/v3/roles/ad532b5de50547a7a0f952954be2d53e => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:52.424210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d415a8-ecf7-448a-8aa3-ef6d5ac1da30 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:52.532746 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d415a8-ecf7-448a-8aa3-ef6d5ac1da30 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:52.562274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:52.569432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62615-0033-4a41-86a7-71672e45c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:52.570312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62615-0033-4a41-86a7-71672e45c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:52.570593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62615-0033-4a41-86a7-71672e45c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:52.570862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c62615-0033-4a41-86a7-71672e45c6e0 None admin] PATH_INFO: `/v3/users/9656b9b49eef460aa099861d0c252314` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:52.572240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c62615-0033-4a41-86a7-71672e45c6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=9656b9b49eef460aa099861d0c252314)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:52.573700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c62615-0033-4a41-86a7-71672e45c6e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:52.575385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 562/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:16:52 2022] GET /identity/v3/users/9656b9b49eef460aa099861d0c252314 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:52.584562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c4502-8df8-401d-a218-67f4158cb5a8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:52.697646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c4502-8df8-401d-a218-67f4158cb5a8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:52.708521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:52.735263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632623a5-d8cc-44c0-af3a-4ae96784a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:52.735904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632623a5-d8cc-44c0-af3a-4ae96784a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:52.736183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632623a5-d8cc-44c0-af3a-4ae96784a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:52.736447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632623a5-d8cc-44c0-af3a-4ae96784a0f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:52.804580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632623a5-d8cc-44c0-af3a-4ae96784a0f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:52.805963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632623a5-d8cc-44c0-af3a-4ae96784a0f5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:52.905894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 566/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:16:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:16:52.912686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62615-0033-4a41-86a7-71672e45c6e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:53.029573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c62615-0033-4a41-86a7-71672e45c6e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:53.068001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a944d8-8ab6-40f1-b6e2-2641ef534a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:53.068818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a944d8-8ab6-40f1-b6e2-2641ef534a10 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:53.069099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a944d8-8ab6-40f1-b6e2-2641ef534a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:53.069373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a944d8-8ab6-40f1-b6e2-2641ef534a10 None admin] PATH_INFO: `/v3/projects/c04572364c8a4004b0e79289ab7ddb86` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:53.070639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a944d8-8ab6-40f1-b6e2-2641ef534a10 None admin] RBAC: Authorizing `identity:get_project(project_id=c04572364c8a4004b0e79289ab7ddb86)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:53.072137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a944d8-8ab6-40f1-b6e2-2641ef534a10 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:53.073887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 563/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:16:52 2022] GET /identity/v3/projects/c04572364c8a4004b0e79289ab7ddb86 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:53.083737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632623a5-d8cc-44c0-af3a-4ae96784a0f5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:53.096285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:53.189323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632623a5-d8cc-44c0-af3a-4ae96784a0f5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:53.228223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc06ec7-4415-415a-bdef-5e9386787c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:53.228891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06ec7-4415-415a-bdef-5e9386787c1a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:53.229178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06ec7-4415-415a-bdef-5e9386787c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:53.229446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06ec7-4415-415a-bdef-5e9386787c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:53.230285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc06ec7-4415-415a-bdef-5e9386787c1a None admin] RBAC: Adding query filter params (role.id=ad532b5de50547a7a0f952954be2d53e, scope.project.id=c04572364c8a4004b0e79289ab7ddb86, user.id=9656b9b49eef460aa099861d0c252314) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:16:53.230597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc06ec7-4415-415a-bdef-5e9386787c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:53.232157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc06ec7-4415-415a-bdef-5e9386787c1a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:53.238435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 567/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:16:53 2022] GET /identity/v3/role_assignments?user.id=9656b9b49eef460aa099861d0c252314&scope.project.id=c04572364c8a4004b0e79289ab7ddb86&role.id=ad532b5de50547a7a0f952954be2d53e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:55.296366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761b5de-05d0-4d54-921b-55e2bf6f4f79 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:55.297223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761b5de-05d0-4d54-921b-55e2bf6f4f79 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:55.297223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761b5de-05d0-4d54-921b-55e2bf6f4f79 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:55.299309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 564/1131] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:55.304906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03276d4-6850-4b46-b146-8a4cc1071cc3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:55.305325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03276d4-6850-4b46-b146-8a4cc1071cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:55.305440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03276d4-6850-4b46-b146-8a4cc1071cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:55.324151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c03276d4-6850-4b46-b146-8a4cc1071cc3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:55.325342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c03276d4-6850-4b46-b146-8a4cc1071cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:55.413343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 568/1132] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:55.438165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761b5de-05d0-4d54-921b-55e2bf6f4f79 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:55.511089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:55.552353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761b5de-05d0-4d54-921b-55e2bf6f4f79 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:55.587588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1361a2-8fcb-4b81-b8ac-4196b1396af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:55.588479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1361a2-8fcb-4b81-b8ac-4196b1396af7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:55.588854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1361a2-8fcb-4b81-b8ac-4196b1396af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:55.589244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1361a2-8fcb-4b81-b8ac-4196b1396af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:55.591086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1361a2-8fcb-4b81-b8ac-4196b1396af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:55.593672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1361a2-8fcb-4b81-b8ac-4196b1396af7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:55.595526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 565/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:55.603188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03276d4-6850-4b46-b146-8a4cc1071cc3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:55.606526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:55.717172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03276d4-6850-4b46-b146-8a4cc1071cc3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:55.754783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbd83b-3eab-408c-a10e-e3aa234761c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:55.755537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd83b-3eab-408c-a10e-e3aa234761c0 None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:55.755811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd83b-3eab-408c-a10e-e3aa234761c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:55.756089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbd83b-3eab-408c-a10e-e3aa234761c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:55.756806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd83b-3eab-408c-a10e-e3aa234761c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:55.758262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbd83b-3eab-408c-a10e-e3aa234761c0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:55.791407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 569/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:16:55 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:16:57.826640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d020b-410f-450a-925f-998a2a5d6092 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:57.827281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d020b-410f-450a-925f-998a2a5d6092 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:57.827281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d020b-410f-450a-925f-998a2a5d6092 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:57.828600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 566/1135] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:16:57.835235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36514733-cd83-4b37-9bae-d6aaf1e77ae8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:57.835919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36514733-cd83-4b37-9bae-d6aaf1e77ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:57.836149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36514733-cd83-4b37-9bae-d6aaf1e77ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:57.859658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-36514733-cd83-4b37-9bae-d6aaf1e77ae8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:16:57.860844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-36514733-cd83-4b37-9bae-d6aaf1e77ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:16:57.919325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:16:57.939100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 570/1136] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:16:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:16:57.963973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d020b-410f-450a-925f-998a2a5d6092 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:58.073871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d020b-410f-450a-925f-998a2a5d6092 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:58.108954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e92d-dcec-4284-bb8d-afc12fba6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:58.109677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e92d-dcec-4284-bb8d-afc12fba6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:58.109953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e92d-dcec-4284-bb8d-afc12fba6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:58.110226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e92d-dcec-4284-bb8d-afc12fba6bd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:58.111551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e92d-dcec-4284-bb8d-afc12fba6bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:58.112993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e92d-dcec-4284-bb8d-afc12fba6bd4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:58.114665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 567/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:16:58.121786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36514733-cd83-4b37-9bae-d6aaf1e77ae8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:16:58.235213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36514733-cd83-4b37-9bae-d6aaf1e77ae8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:16:58.271144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399ba0-9a0c-415c-89a7-0d5098787f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:16:58.271814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399ba0-9a0c-415c-89a7-0d5098787f3b None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:16:58.272098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399ba0-9a0c-415c-89a7-0d5098787f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:16:58.272372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399ba0-9a0c-415c-89a7-0d5098787f3b None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:16:58.273083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04399ba0-9a0c-415c-89a7-0d5098787f3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:16:58.274547 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04399ba0-9a0c-415c-89a7-0d5098787f3b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:16:58.296017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 571/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:16:58 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:17:00.353005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a638-fcca-439f-a783-041819111e41 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:00.353520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a638-fcca-439f-a783-041819111e41 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:00.353520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a638-fcca-439f-a783-041819111e41 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:00.355612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 568/1139] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:00.363693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83325f8-26ce-4cbe-a727-534e8b4ac9f1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:00.364143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83325f8-26ce-4cbe-a727-534e8b4ac9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:00.364254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83325f8-26ce-4cbe-a727-534e8b4ac9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:00.383306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e83325f8-26ce-4cbe-a727-534e8b4ac9f1 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:00.384488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e83325f8-26ce-4cbe-a727-534e8b4ac9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:00.422131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:00.456239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 572/1140] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:17:00.479637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995a638-fcca-439f-a783-041819111e41 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:00.482793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:00.588884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995a638-fcca-439f-a783-041819111e41 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:00.626298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cb871-bbbd-46e4-9d09-904a093f7934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:00.627008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb871-bbbd-46e4-9d09-904a093f7934 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:00.627316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb871-bbbd-46e4-9d09-904a093f7934 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:00.627585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb871-bbbd-46e4-9d09-904a093f7934 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:00.638325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cb871-bbbd-46e4-9d09-904a093f7934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-fc3cb871-bbbd-46e4-9d09-904a093f7934 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:17:00.645990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:17:00.647154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:17:00.648967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 569/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:17:00.656640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83325f8-26ce-4cbe-a727-534e8b4ac9f1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:00.771048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83325f8-26ce-4cbe-a727-534e8b4ac9f1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:00.808495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:00.809163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:00.809446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:00.809721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:00.810469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:00.810777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:00.812216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:00.820601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 573/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:00.826763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cb871-bbbd-46e4-9d09-904a093f7934 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:00.893194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:00.934271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cb871-bbbd-46e4-9d09-904a093f7934 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:00.970356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defc03-9a38-434e-87cf-c80bca4b8c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:00.971260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defc03-9a38-434e-87cf-c80bca4b8c6f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:00.971534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defc03-9a38-434e-87cf-c80bca4b8c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:00.971803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defc03-9a38-434e-87cf-c80bca4b8c6f None admin] PATH_INFO: `/v3/users/c80f50e65a0c412a805d814168ef6f9e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:00.985720 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defc03-9a38-434e-87cf-c80bca4b8c6f None admin] RBAC: Authorizing `identity:get_user(user_id=c80f50e65a0c412a805d814168ef6f9e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:00.987258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defc03-9a38-434e-87cf-c80bca4b8c6f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:00.988914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 570/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:17:00 2022] GET /identity/v3/users/c80f50e65a0c412a805d814168ef6f9e => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:17:00.995693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:01.031551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:01.100101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286082d-24c4-45d7-9dfc-901f65a619c3 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:01.135377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657a345-3085-4148-a9d4-c4b035d9ed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:01.136009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a345-3085-4148-a9d4-c4b035d9ed6e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:01.136290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a345-3085-4148-a9d4-c4b035d9ed6e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:01.136561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a345-3085-4148-a9d4-c4b035d9ed6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:01.207407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657a345-3085-4148-a9d4-c4b035d9ed6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:01.208918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657a345-3085-4148-a9d4-c4b035d9ed6e None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:01.242375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:01.314742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 574/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:17:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:17:01.320982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defc03-9a38-434e-87cf-c80bca4b8c6f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:01.423696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defc03-9a38-434e-87cf-c80bca4b8c6f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:01.443976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:01.467338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287386b-ae2d-436c-83f7-c58358346e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:01.468575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287386b-ae2d-436c-83f7-c58358346e55 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:01.468957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287386b-ae2d-436c-83f7-c58358346e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:01.469215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287386b-ae2d-436c-83f7-c58358346e55 None admin] PATH_INFO: `/v3/projects/2c4407e5bf314c5cb49d6d6cf1df93b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:01.471411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287386b-ae2d-436c-83f7-c58358346e55 None admin] RBAC: Authorizing `identity:get_project(project_id=2c4407e5bf314c5cb49d6d6cf1df93b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:01.473665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287386b-ae2d-436c-83f7-c58358346e55 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:01.475529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 571/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:17:01 2022] GET /identity/v3/projects/2c4407e5bf314c5cb49d6d6cf1df93b1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:01.484671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657a345-3085-4148-a9d4-c4b035d9ed6e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:01.592916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657a345-3085-4148-a9d4-c4b035d9ed6e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:01.628356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087cc7c-ac7f-40e6-b097-1d69ec0991d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:01.629007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087cc7c-ac7f-40e6-b097-1d69ec0991d2 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:01.629288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087cc7c-ac7f-40e6-b097-1d69ec0991d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:01.629561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087cc7c-ac7f-40e6-b097-1d69ec0991d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:01.630494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087cc7c-ac7f-40e6-b097-1d69ec0991d2 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=2c4407e5bf314c5cb49d6d6cf1df93b1, user.id=c80f50e65a0c412a805d814168ef6f9e) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:01.630805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087cc7c-ac7f-40e6-b097-1d69ec0991d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:01.632284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087cc7c-ac7f-40e6-b097-1d69ec0991d2 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:01.634137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:01.638843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 575/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:17:01 2022] GET /identity/v3/role_assignments?user.id=c80f50e65a0c412a805d814168ef6f9e&scope.project.id=2c4407e5bf314c5cb49d6d6cf1df93b1&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:03.639366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2f31-3983-44df-b413-e9d5b5ffc20a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:03.639934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2f31-3983-44df-b413-e9d5b5ffc20a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:03.639934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2f31-3983-44df-b413-e9d5b5ffc20a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:03.641379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 572/1147] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:03.648679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1346c6-ff35-436f-9a38-e15b6f6cac90 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:03.649127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1346c6-ff35-436f-9a38-e15b6f6cac90 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:03.649215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1346c6-ff35-436f-9a38-e15b6f6cac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:03.667722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0c1346c6-ff35-436f-9a38-e15b6f6cac90 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:03.668912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c1346c6-ff35-436f-9a38-e15b6f6cac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:03.745446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 576/1148] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:03.771987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2f31-3983-44df-b413-e9d5b5ffc20a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:03.893473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2f31-3983-44df-b413-e9d5b5ffc20a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:03.928746 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28df54-7bd2-46e5-95fe-82302539d167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:03.929556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28df54-7bd2-46e5-95fe-82302539d167 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:03.929824 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28df54-7bd2-46e5-95fe-82302539d167 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:03.930096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28df54-7bd2-46e5-95fe-82302539d167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:03.941074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28df54-7bd2-46e5-95fe-82302539d167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cd28df54-7bd2-46e5-95fe-82302539d167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:17:03.948845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:17:03.950691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:17:03.952076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 573/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:17:03.958196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1346c6-ff35-436f-9a38-e15b6f6cac90 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:04.066582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1346c6-ff35-436f-9a38-e15b6f6cac90 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:04.093507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:04.106120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:04.107210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:04.107653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:04.108090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:04.109286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:04.109755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:04.112059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:04.122201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 577/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:04.128331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28df54-7bd2-46e5-95fe-82302539d167 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:04.182348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:04.235460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28df54-7bd2-46e5-95fe-82302539d167 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:04.271325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f1ab5-3a29-404a-a708-d7dc67879329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:04.272191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1ab5-3a29-404a-a708-d7dc67879329 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:04.272468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1ab5-3a29-404a-a708-d7dc67879329 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:04.272740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1ab5-3a29-404a-a708-d7dc67879329 None admin] PATH_INFO: `/v3/users/c80f50e65a0c412a805d814168ef6f9e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:04.273972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f1ab5-3a29-404a-a708-d7dc67879329 None admin] RBAC: Authorizing `identity:get_user(user_id=c80f50e65a0c412a805d814168ef6f9e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:04.275457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f1ab5-3a29-404a-a708-d7dc67879329 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:04.277068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 574/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:17:04 2022] GET /identity/v3/users/c80f50e65a0c412a805d814168ef6f9e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:04.283805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:04.410433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2763f-7b13-4593-9ef3-7baf128f550f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:04.446494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928a8e3-ab93-4dee-b634-0c1ae3375539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:04.447402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928a8e3-ab93-4dee-b634-0c1ae3375539 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:04.447680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928a8e3-ab93-4dee-b634-0c1ae3375539 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:04.447955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928a8e3-ab93-4dee-b634-0c1ae3375539 None admin] PATH_INFO: `/v3/projects/2c4407e5bf314c5cb49d6d6cf1df93b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:04.449269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928a8e3-ab93-4dee-b634-0c1ae3375539 None admin] RBAC: Authorizing `identity:get_project(project_id=2c4407e5bf314c5cb49d6d6cf1df93b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:04.450728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928a8e3-ab93-4dee-b634-0c1ae3375539 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:04.452483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 578/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:17:04 2022] GET /identity/v3/projects/2c4407e5bf314c5cb49d6d6cf1df93b1 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:04.462709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f1ab5-3a29-404a-a708-d7dc67879329 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:04.572184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f1ab5-3a29-404a-a708-d7dc67879329 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:04.590903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:04.617068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64865-6e6d-433d-9872-7765c3869621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:04.618372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64865-6e6d-433d-9872-7765c3869621 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:04.618744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64865-6e6d-433d-9872-7765c3869621 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:04.619144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64865-6e6d-433d-9872-7765c3869621 None admin] PATH_INFO: `/v3/projects/2c4407e5bf314c5cb49d6d6cf1df93b1/users/c80f50e65a0c412a805d814168ef6f9e/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:04.622747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb64865-6e6d-433d-9872-7765c3869621 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c4407e5bf314c5cb49d6d6cf1df93b1, user_id=c80f50e65a0c412a805d814168ef6f9e, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:04.625068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb64865-6e6d-433d-9872-7765c3869621 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:04.641810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 575/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:17:04 2022] PUT /identity/v3/projects/2c4407e5bf314c5cb49d6d6cf1df93b1/users/c80f50e65a0c412a805d814168ef6f9e/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:17:06.701454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b379c8b-d976-4f84-942f-8f8d753b79ec None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:06.702052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b379c8b-d976-4f84-942f-8f8d753b79ec None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:06.702052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b379c8b-d976-4f84-942f-8f8d753b79ec None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:06.703570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 579/1154] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:06.709392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c06d-e323-4089-9bc2-64d6cfe2729c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:06.709824 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c06d-e323-4089-9bc2-64d6cfe2729c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:06.709914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c06d-e323-4089-9bc2-64d6cfe2729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:06.729730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-89b2c06d-e323-4089-9bc2-64d6cfe2729c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:06.730928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-89b2c06d-e323-4089-9bc2-64d6cfe2729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:06.814145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 576/1155] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:06.841484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b379c8b-d976-4f84-942f-8f8d753b79ec None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:06.919676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:06.969345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b379c8b-d976-4f84-942f-8f8d753b79ec None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:07.005170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d781dc-2c78-476b-aad5-b3ae146f0772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:07.005967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d781dc-2c78-476b-aad5-b3ae146f0772 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:07.006257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d781dc-2c78-476b-aad5-b3ae146f0772 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:07.006526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d781dc-2c78-476b-aad5-b3ae146f0772 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:07.017870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d781dc-2c78-476b-aad5-b3ae146f0772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e4d781dc-2c78-476b-aad5-b3ae146f0772 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:17:07.025583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:17:07.026629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:17:07.027554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 580/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:17:07.033115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2c06d-e323-4089-9bc2-64d6cfe2729c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:07.152401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2c06d-e323-4089-9bc2-64d6cfe2729c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:07.160324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:07.193099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:07.193773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:07.194053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:07.194322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:07.195097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:07.195404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:07.196797 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:07.204683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 577/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:07.211565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d781dc-2c78-476b-aad5-b3ae146f0772 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:07.322449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d781dc-2c78-476b-aad5-b3ae146f0772 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:07.340396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:07.367572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387de47-5ac1-4e27-bd1c-58462c0123f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:07.368438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387de47-5ac1-4e27-bd1c-58462c0123f7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:07.368777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387de47-5ac1-4e27-bd1c-58462c0123f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:07.369055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387de47-5ac1-4e27-bd1c-58462c0123f7 None admin] PATH_INFO: `/v3/users/c80f50e65a0c412a805d814168ef6f9e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:07.370587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387de47-5ac1-4e27-bd1c-58462c0123f7 None admin] RBAC: Authorizing `identity:get_user(user_id=c80f50e65a0c412a805d814168ef6f9e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:07.372098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387de47-5ac1-4e27-bd1c-58462c0123f7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:07.373749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 581/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:17:07 2022] GET /identity/v3/users/c80f50e65a0c412a805d814168ef6f9e => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:07.380336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:07.488602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca70479-16ea-452c-b891-18c5d3971b9e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:07.524044 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853048-b935-4595-a57b-7488c41969ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:07.524675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853048-b935-4595-a57b-7488c41969ee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:07.524951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853048-b935-4595-a57b-7488c41969ee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:07.525218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee853048-b935-4595-a57b-7488c41969ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:07.561219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:07.599049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee853048-b935-4595-a57b-7488c41969ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:07.600448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee853048-b935-4595-a57b-7488c41969ee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:07.704012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 578/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:17:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:17:07.713805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387de47-5ac1-4e27-bd1c-58462c0123f7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:07.822164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387de47-5ac1-4e27-bd1c-58462c0123f7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:07.860494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e45f8f-e427-4e1a-b3e5-b52a63123f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:07.861285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e45f8f-e427-4e1a-b3e5-b52a63123f44 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:07.861564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e45f8f-e427-4e1a-b3e5-b52a63123f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:07.861833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e45f8f-e427-4e1a-b3e5-b52a63123f44 None admin] PATH_INFO: `/v3/projects/2c4407e5bf314c5cb49d6d6cf1df93b1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:07.863175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e45f8f-e427-4e1a-b3e5-b52a63123f44 None admin] RBAC: Authorizing `identity:get_project(project_id=2c4407e5bf314c5cb49d6d6cf1df93b1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:07.864947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e45f8f-e427-4e1a-b3e5-b52a63123f44 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:07.866636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 582/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:17:07 2022] GET /identity/v3/projects/2c4407e5bf314c5cb49d6d6cf1df93b1 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:07.873451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853048-b935-4595-a57b-7488c41969ee None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:07.945938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:07.982276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee853048-b935-4595-a57b-7488c41969ee None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:08.020788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db76011-01a0-4379-a4cb-f8e78c470b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:08.021437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db76011-01a0-4379-a4cb-f8e78c470b68 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:08.021716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db76011-01a0-4379-a4cb-f8e78c470b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:08.021988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db76011-01a0-4379-a4cb-f8e78c470b68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:08.022825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db76011-01a0-4379-a4cb-f8e78c470b68 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=2c4407e5bf314c5cb49d6d6cf1df93b1, user.id=c80f50e65a0c412a805d814168ef6f9e) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:08.023164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db76011-01a0-4379-a4cb-f8e78c470b68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:08.024612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db76011-01a0-4379-a4cb-f8e78c470b68 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:08.030559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 579/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:17:07 2022] GET /identity/v3/role_assignments?user.id=c80f50e65a0c412a805d814168ef6f9e&scope.project.id=2c4407e5bf314c5cb49d6d6cf1df93b1&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:10.064471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee0cbd-08e9-442f-8018-38fb31595749 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:10.065215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee0cbd-08e9-442f-8018-38fb31595749 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:10.065376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee0cbd-08e9-442f-8018-38fb31595749 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:10.067802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 583/1162] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:10.075308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70afa7-48f0-43f7-a5e2-cf1e86538872 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:10.076055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70afa7-48f0-43f7-a5e2-cf1e86538872 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:10.076319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70afa7-48f0-43f7-a5e2-cf1e86538872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:10.097784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-da70afa7-48f0-43f7-a5e2-cf1e86538872 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:10.098993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-da70afa7-48f0-43f7-a5e2-cf1e86538872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:10.182763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 580/1163] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:10.215515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee0cbd-08e9-442f-8018-38fb31595749 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:10.278142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:10.336315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee0cbd-08e9-442f-8018-38fb31595749 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:10.373621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0054b1a-159d-4684-b6b8-507ce8418c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:10.374260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0054b1a-159d-4684-b6b8-507ce8418c6d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:10.374541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0054b1a-159d-4684-b6b8-507ce8418c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:10.374816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0054b1a-159d-4684-b6b8-507ce8418c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:10.448685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0054b1a-159d-4684-b6b8-507ce8418c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:10.450147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0054b1a-159d-4684-b6b8-507ce8418c6d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:10.510289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:10.561092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 584/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:17:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:17:10.567426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70afa7-48f0-43f7-a5e2-cf1e86538872 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:10.630172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:10.669326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70afa7-48f0-43f7-a5e2-cf1e86538872 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:10.704269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436996bc-0427-4625-93f4-8fdf34890bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:10.705073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436996bc-0427-4625-93f4-8fdf34890bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:10.705350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436996bc-0427-4625-93f4-8fdf34890bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:10.705621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436996bc-0427-4625-93f4-8fdf34890bb7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:10.713102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436996bc-0427-4625-93f4-8fdf34890bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:10.714563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436996bc-0427-4625-93f4-8fdf34890bb7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-436996bc-0427-4625-93f4-8fdf34890bb7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:17:10.729454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:17:10.730628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:17:10.731744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 581/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:17:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:17:10.738551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0054b1a-159d-4684-b6b8-507ce8418c6d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:10.843776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0054b1a-159d-4684-b6b8-507ce8418c6d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:10.880239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1560e-f65d-459f-ad0d-decf6e6982d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:10.880886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1560e-f65d-459f-ad0d-decf6e6982d5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:10.881166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1560e-f65d-459f-ad0d-decf6e6982d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:10.881443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1560e-f65d-459f-ad0d-decf6e6982d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:10.882161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1560e-f65d-459f-ad0d-decf6e6982d5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:10.882463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1560e-f65d-459f-ad0d-decf6e6982d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:10.883876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1560e-f65d-459f-ad0d-decf6e6982d5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:10.891158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 585/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jul 20 15:17:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:12.902166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ff3e-adb9-4925-9784-17d73f62ed98 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:12.902740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ff3e-adb9-4925-9784-17d73f62ed98 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:12.902740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ff3e-adb9-4925-9784-17d73f62ed98 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:12.904128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 582/1167] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:12.910603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f0d25-ea39-46f9-bdf9-1ec4768f7229 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:12.911295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f0d25-ea39-46f9-bdf9-1ec4768f7229 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:12.911447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f0d25-ea39-46f9-bdf9-1ec4768f7229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:12.938518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b19f0d25-ea39-46f9-bdf9-1ec4768f7229 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:12.939826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b19f0d25-ea39-46f9-bdf9-1ec4768f7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:12.954511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:13.014919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 586/1168] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:13.038574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ff3e-adb9-4925-9784-17d73f62ed98 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:13.154567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ff3e-adb9-4925-9784-17d73f62ed98 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:13.177607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:13.190224 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3d729-63c9-42c3-950d-1566b941e353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:13.190887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d729-63c9-42c3-950d-1566b941e353 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:13.191272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d729-63c9-42c3-950d-1566b941e353 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:13.191541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3d729-63c9-42c3-950d-1566b941e353 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:13.192304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3d729-63c9-42c3-950d-1566b941e353 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:13.193686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3d729-63c9-42c3-950d-1566b941e353 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:13.214902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 583/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Wed Jul 20 15:17:13 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:17:15.251002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb959-d9fb-4924-accb-661d23b7e7c8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:15.251536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb959-d9fb-4924-accb-661d23b7e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:15.251536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb959-d9fb-4924-accb-661d23b7e7c8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:15.252875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 587/1170] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:15.259385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dd52d-28e1-4f7b-8493-f311308b8131 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:15.260156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dd52d-28e1-4f7b-8493-f311308b8131 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:15.260307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dd52d-28e1-4f7b-8493-f311308b8131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:15.283130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e84dd52d-28e1-4f7b-8493-f311308b8131 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:15.284329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e84dd52d-28e1-4f7b-8493-f311308b8131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:15.355907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 584/1171] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:15.383583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cb959-d9fb-4924-accb-661d23b7e7c8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:15.489792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cb959-d9fb-4924-accb-661d23b7e7c8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:15.534773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537aeca-570a-4bca-9eab-affe28baffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:15.535626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537aeca-570a-4bca-9eab-affe28baffc4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:15.535908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537aeca-570a-4bca-9eab-affe28baffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:15.536190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537aeca-570a-4bca-9eab-affe28baffc4 None admin] PATH_INFO: `/v3/domains/639d025756a84baba9a3aa971d2c5ccc` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:15.547687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537aeca-570a-4bca-9eab-affe28baffc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=639d025756a84baba9a3aa971d2c5ccc)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:15.549168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537aeca-570a-4bca-9eab-affe28baffc4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:15.550775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 588/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Jul 20 15:17:15 2022] GET /identity/v3/domains/639d025756a84baba9a3aa971d2c5ccc => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:15.557697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dd52d-28e1-4f7b-8493-f311308b8131 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:15.675416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dd52d-28e1-4f7b-8493-f311308b8131 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:15.696100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:15.720072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910366f-fca8-43dc-b15d-ecfd6b08f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:15.720736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910366f-fca8-43dc-b15d-ecfd6b08f9c5 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:15.721017 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910366f-fca8-43dc-b15d-ecfd6b08f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:15.721291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910366f-fca8-43dc-b15d-ecfd6b08f9c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:15.722003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910366f-fca8-43dc-b15d-ecfd6b08f9c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:15.723511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910366f-fca8-43dc-b15d-ecfd6b08f9c5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:15.749929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 585/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:17:15 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:17:17.795651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a6b46-fb5c-4752-9f49-13e57a3b0806 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:17.796333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a6b46-fb5c-4752-9f49-13e57a3b0806 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:17.796333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a6b46-fb5c-4752-9f49-13e57a3b0806 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:17.797600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 589/1174] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:17.804348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa7d1-d416-444a-b18d-4812e7c38f59 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:17.805130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa7d1-d416-444a-b18d-4812e7c38f59 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:17.805270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa7d1-d416-444a-b18d-4812e7c38f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:17.833171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-faeaa7d1-d416-444a-b18d-4812e7c38f59 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:17.834770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-faeaa7d1-d416-444a-b18d-4812e7c38f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:17.906445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 586/1175] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:17.942719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a6b46-fb5c-4752-9f49-13e57a3b0806 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:17.955464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:18.054918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a6b46-fb5c-4752-9f49-13e57a3b0806 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:18.092303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9568b-2f5c-4ada-a17e-2e9eac1896ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:18.093170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9568b-2f5c-4ada-a17e-2e9eac1896ea None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:18.093480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9568b-2f5c-4ada-a17e-2e9eac1896ea None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:18.093751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9568b-2f5c-4ada-a17e-2e9eac1896ea None admin] PATH_INFO: `/v3/domains/639d025756a84baba9a3aa971d2c5ccc` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:18.095098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9568b-2f5c-4ada-a17e-2e9eac1896ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=639d025756a84baba9a3aa971d2c5ccc)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:18.096567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9568b-2f5c-4ada-a17e-2e9eac1896ea None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:18.098214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 590/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Jul 20 15:17:17 2022] GET /identity/v3/domains/639d025756a84baba9a3aa971d2c5ccc => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:18.104616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaa7d1-d416-444a-b18d-4812e7c38f59 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:18.203709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:18.210736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaa7d1-d416-444a-b18d-4812e7c38f59 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:18.245665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5830a8b-c5b2-45cc-bb02-ebc02eae7c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:18.246344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5830a8b-c5b2-45cc-bb02-ebc02eae7c89 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:18.246620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5830a8b-c5b2-45cc-bb02-ebc02eae7c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:18.246884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5830a8b-c5b2-45cc-bb02-ebc02eae7c89 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:18.247629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5830a8b-c5b2-45cc-bb02-ebc02eae7c89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:18.249072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5830a8b-c5b2-45cc-bb02-ebc02eae7c89 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:18.272120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 587/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:17:18 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:17:20.357051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c5238-9a65-4b01-a144-19e27824a56b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:20.357609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c5238-9a65-4b01-a144-19e27824a56b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:20.357609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c5238-9a65-4b01-a144-19e27824a56b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:20.358869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 591/1178] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:20.365304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24923b71-63dc-4e0f-8eb8-532d83af5788 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:20.366032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24923b71-63dc-4e0f-8eb8-532d83af5788 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:20.366208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24923b71-63dc-4e0f-8eb8-532d83af5788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:20.389540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-24923b71-63dc-4e0f-8eb8-532d83af5788 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:20.390740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-24923b71-63dc-4e0f-8eb8-532d83af5788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:20.461345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 588/1179] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:20.484966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c5238-9a65-4b01-a144-19e27824a56b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:20.569938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:20.599489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c5238-9a65-4b01-a144-19e27824a56b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:20.636907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04c711-234d-4038-84a3-8ab58df7317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:20.637629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04c711-234d-4038-84a3-8ab58df7317e None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:20.637909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04c711-234d-4038-84a3-8ab58df7317e None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:20.638181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04c711-234d-4038-84a3-8ab58df7317e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:20.653692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04c711-234d-4038-84a3-8ab58df7317e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-6b04c711-234d-4038-84a3-8ab58df7317e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:17:20.666387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:17:20.667682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:17:20.668818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 592/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:17:20.675666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24923b71-63dc-4e0f-8eb8-532d83af5788 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:20.759165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:20.785345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24923b71-63dc-4e0f-8eb8-532d83af5788 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:20.824430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:20.825092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:20.825372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:20.825643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:20.826393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:20.826699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:20.828128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:20.836964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 589/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:17:20.843287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04c711-234d-4038-84a3-8ab58df7317e None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:20.974999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04c711-234d-4038-84a3-8ab58df7317e None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:21.014631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf011d1-3e55-43f6-9ebe-6bf423acf172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:21.015965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf011d1-3e55-43f6-9ebe-6bf423acf172 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:21.016337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf011d1-3e55-43f6-9ebe-6bf423acf172 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:21.016713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf011d1-3e55-43f6-9ebe-6bf423acf172 None admin] PATH_INFO: `/v3/users/9561b2b6558a4705a1bd3870baf1d2da` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:21.021685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:21.039414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf011d1-3e55-43f6-9ebe-6bf423acf172 None admin] RBAC: Authorizing `identity:get_user(user_id=9561b2b6558a4705a1bd3870baf1d2da)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:21.040892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf011d1-3e55-43f6-9ebe-6bf423acf172 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:21.042570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 593/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:17:20 2022] GET /identity/v3/users/9561b2b6558a4705a1bd3870baf1d2da => generated 311 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:21.052328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:21.169679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa4df9-fde5-4071-8fe3-0af35f2dfccf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:21.203964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3ebbe-80e3-4be4-b2d4-782d06380850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:21.204549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ebbe-80e3-4be4-b2d4-782d06380850 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:21.204829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ebbe-80e3-4be4-b2d4-782d06380850 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:21.205106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ebbe-80e3-4be4-b2d4-782d06380850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:21.217220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:21.272156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3ebbe-80e3-4be4-b2d4-782d06380850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:21.273614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3ebbe-80e3-4be4-b2d4-782d06380850 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:21.389051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 590/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:17:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:17:21.397900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf011d1-3e55-43f6-9ebe-6bf423acf172 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:21.509754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf011d1-3e55-43f6-9ebe-6bf423acf172 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:21.551967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0bb23-267a-4d5f-a9ae-7e90d82d1a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:21.552926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0bb23-267a-4d5f-a9ae-7e90d82d1a11 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:21.553205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0bb23-267a-4d5f-a9ae-7e90d82d1a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:21.553480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0bb23-267a-4d5f-a9ae-7e90d82d1a11 None admin] PATH_INFO: `/v3/projects/026162dc8df74e1491b6f5cdfebcb3ac` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:21.554821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0bb23-267a-4d5f-a9ae-7e90d82d1a11 None admin] RBAC: Authorizing `identity:get_project(project_id=026162dc8df74e1491b6f5cdfebcb3ac)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:21.556345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0bb23-267a-4d5f-a9ae-7e90d82d1a11 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:21.558077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 594/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:17:21 2022] GET /identity/v3/projects/026162dc8df74e1491b6f5cdfebcb3ac => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:21.565258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3ebbe-80e3-4be4-b2d4-782d06380850 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:21.618794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:21.690237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3ebbe-80e3-4be4-b2d4-782d06380850 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:21.726413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c48f5-bbe0-49ac-9491-23aa889b823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:21.727098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c48f5-bbe0-49ac-9491-23aa889b823a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:21.727380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c48f5-bbe0-49ac-9491-23aa889b823a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:21.727649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c48f5-bbe0-49ac-9491-23aa889b823a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:21.728480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c48f5-bbe0-49ac-9491-23aa889b823a None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=026162dc8df74e1491b6f5cdfebcb3ac, user.id=9561b2b6558a4705a1bd3870baf1d2da) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:21.728784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c48f5-bbe0-49ac-9491-23aa889b823a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:21.730255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c48f5-bbe0-49ac-9491-23aa889b823a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:21.735874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 591/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:17:21 2022] GET /identity/v3/role_assignments?user.id=9561b2b6558a4705a1bd3870baf1d2da&scope.project.id=026162dc8df74e1491b6f5cdfebcb3ac&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:23.710747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659adf8-5e6a-4d8c-8eb2-acb0d02e50c9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:23.711361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659adf8-5e6a-4d8c-8eb2-acb0d02e50c9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:23.711361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659adf8-5e6a-4d8c-8eb2-acb0d02e50c9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:23.712709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 595/1186] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:23.719286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa836db-3a64-42be-8deb-099e7c204eda None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:23.720019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa836db-3a64-42be-8deb-099e7c204eda None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:23.720177 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa836db-3a64-42be-8deb-099e7c204eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:23.746112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-eaa836db-3a64-42be-8deb-099e7c204eda None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:23.747345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eaa836db-3a64-42be-8deb-099e7c204eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:23.825069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 592/1187] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:23.847799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659adf8-5e6a-4d8c-8eb2-acb0d02e50c9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:23.919731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:23.968734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659adf8-5e6a-4d8c-8eb2-acb0d02e50c9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:24.004642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716a505-09ca-40e7-867b-b1b9e6d8a17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:24.005430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a505-09ca-40e7-867b-b1b9e6d8a17a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:24.005768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a505-09ca-40e7-867b-b1b9e6d8a17a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:24.006037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a505-09ca-40e7-867b-b1b9e6d8a17a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:24.016139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716a505-09ca-40e7-867b-b1b9e6d8a17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-3716a505-09ca-40e7-867b-b1b9e6d8a17a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:17:24.023724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:17:24.024739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:24.025770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:17:24.027300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 596/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:17:24.031173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa836db-3a64-42be-8deb-099e7c204eda None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:24.068153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:24.149152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa836db-3a64-42be-8deb-099e7c204eda None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:24.184519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:24.185175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:24.185453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:24.185718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:24.186463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:24.186760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:24.188176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:24.196039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 593/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:24.202211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716a505-09ca-40e7-867b-b1b9e6d8a17a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:24.307784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716a505-09ca-40e7-867b-b1b9e6d8a17a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:24.335915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:24.351545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebd4c-0007-46b3-99a9-69b277d28982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:24.352430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebd4c-0007-46b3-99a9-69b277d28982 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:24.352703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebd4c-0007-46b3-99a9-69b277d28982 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:24.352967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebd4c-0007-46b3-99a9-69b277d28982 None admin] PATH_INFO: `/v3/users/9561b2b6558a4705a1bd3870baf1d2da` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:24.354294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ebd4c-0007-46b3-99a9-69b277d28982 None admin] RBAC: Authorizing `identity:get_user(user_id=9561b2b6558a4705a1bd3870baf1d2da)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:24.355769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ebd4c-0007-46b3-99a9-69b277d28982 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:24.357415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 597/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:17:24 2022] GET /identity/v3/users/9561b2b6558a4705a1bd3870baf1d2da => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:24.364323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:24.475202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:24.479288 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d7d53-fbdf-44de-8203-116b98aab6ba None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:24.517561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c88ce-f766-4925-b022-5d8dba287897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:24.518432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c88ce-f766-4925-b022-5d8dba287897 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:24.518712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c88ce-f766-4925-b022-5d8dba287897 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:24.519009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c88ce-f766-4925-b022-5d8dba287897 None admin] PATH_INFO: `/v3/projects/026162dc8df74e1491b6f5cdfebcb3ac` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:24.520333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c88ce-f766-4925-b022-5d8dba287897 None admin] RBAC: Authorizing `identity:get_project(project_id=026162dc8df74e1491b6f5cdfebcb3ac)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:24.521890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c88ce-f766-4925-b022-5d8dba287897 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:24.523628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 594/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:17:24 2022] GET /identity/v3/projects/026162dc8df74e1491b6f5cdfebcb3ac => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:24.529941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebd4c-0007-46b3-99a9-69b277d28982 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:24.633869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebd4c-0007-46b3-99a9-69b277d28982 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:24.678170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2a47f-3791-4b8a-96b3-a78d9b8083e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:24.679091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2a47f-3791-4b8a-96b3-a78d9b8083e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:24.679370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2a47f-3791-4b8a-96b3-a78d9b8083e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:24.679644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2a47f-3791-4b8a-96b3-a78d9b8083e7 None admin] PATH_INFO: `/v3/projects/026162dc8df74e1491b6f5cdfebcb3ac/users/9561b2b6558a4705a1bd3870baf1d2da/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:24.681892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2a47f-3791-4b8a-96b3-a78d9b8083e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=026162dc8df74e1491b6f5cdfebcb3ac, user_id=9561b2b6558a4705a1bd3870baf1d2da, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:24.683369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2a47f-3791-4b8a-96b3-a78d9b8083e7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:24.698792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 598/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:17:24 2022] PUT /identity/v3/projects/026162dc8df74e1491b6f5cdfebcb3ac/users/9561b2b6558a4705a1bd3870baf1d2da/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:17:26.686588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d242c9-46a8-4aa2-93bb-70118edb3bc1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:26.687570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d242c9-46a8-4aa2-93bb-70118edb3bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:26.687570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d242c9-46a8-4aa2-93bb-70118edb3bc1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:26.689758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 595/1193] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:17:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:17:26.698607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f303e8-081e-457a-95f8-9e1670865674 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:26.699400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f303e8-081e-457a-95f8-9e1670865674 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:26.699601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f303e8-081e-457a-95f8-9e1670865674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:26.720636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-44f303e8-081e-457a-95f8-9e1670865674 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:17:26.721813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-44f303e8-081e-457a-95f8-9e1670865674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:17:26.771119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:26.794550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 599/1194] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:17:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:17:26.821331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d242c9-46a8-4aa2-93bb-70118edb3bc1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:26.940238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d242c9-46a8-4aa2-93bb-70118edb3bc1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:26.979400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb91bc6-6b73-4f66-95fb-2cec44d80119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:26.980196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb91bc6-6b73-4f66-95fb-2cec44d80119 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:26.980473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb91bc6-6b73-4f66-95fb-2cec44d80119 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:26.980743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb91bc6-6b73-4f66-95fb-2cec44d80119 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:26.991146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb91bc6-6b73-4f66-95fb-2cec44d80119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cdb91bc6-6b73-4f66-95fb-2cec44d80119 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:17:26.999157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:17:27.000272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:17:27.001305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 596/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:17:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:17:27.007372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f303e8-081e-457a-95f8-9e1670865674 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:27.121040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f303e8-081e-457a-95f8-9e1670865674 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:27.160581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:27.161237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:27.161512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:27.161843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:27.162573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:27.162868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:27.164327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:27.172664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 600/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:27.178841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb91bc6-6b73-4f66-95fb-2cec44d80119 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:27.217233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:27.297519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb91bc6-6b73-4f66-95fb-2cec44d80119 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:27.335395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb37d85-9ec5-4c71-b99e-491994a23d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:27.336258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb37d85-9ec5-4c71-b99e-491994a23d60 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:27.336528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb37d85-9ec5-4c71-b99e-491994a23d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:27.336793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb37d85-9ec5-4c71-b99e-491994a23d60 None admin] PATH_INFO: `/v3/users/9561b2b6558a4705a1bd3870baf1d2da` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:27.338267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb37d85-9ec5-4c71-b99e-491994a23d60 None admin] RBAC: Authorizing `identity:get_user(user_id=9561b2b6558a4705a1bd3870baf1d2da)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:27.339747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb37d85-9ec5-4c71-b99e-491994a23d60 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:27.341365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 597/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jul 20 15:17:27 2022] GET /identity/v3/users/9561b2b6558a4705a1bd3870baf1d2da => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:27.347754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:27.396257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:27.454407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d890228-7d0c-4284-aba6-6269dcf6aea6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:27.490056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d0c4b-9a6a-4d0f-99d2-e97c518dadc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:27.490789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d0c4b-9a6a-4d0f-99d2-e97c518dadc4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:27.491082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d0c4b-9a6a-4d0f-99d2-e97c518dadc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:27.491375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d0c4b-9a6a-4d0f-99d2-e97c518dadc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:27.562957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d0c4b-9a6a-4d0f-99d2-e97c518dadc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:27.564466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d0c4b-9a6a-4d0f-99d2-e97c518dadc4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:27.612190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:27.675740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 601/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:17:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:17:27.682472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb37d85-9ec5-4c71-b99e-491994a23d60 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:27.781642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:27.789273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb37d85-9ec5-4c71-b99e-491994a23d60 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:27.831962 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aeaaa8-ba69-4602-b3f0-19431ef9236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:27.832842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeaaa8-ba69-4602-b3f0-19431ef9236d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:27.833123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeaaa8-ba69-4602-b3f0-19431ef9236d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:27.833394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeaaa8-ba69-4602-b3f0-19431ef9236d None admin] PATH_INFO: `/v3/projects/026162dc8df74e1491b6f5cdfebcb3ac` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:27.834811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aeaaa8-ba69-4602-b3f0-19431ef9236d None admin] RBAC: Authorizing `identity:get_project(project_id=026162dc8df74e1491b6f5cdfebcb3ac)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:27.836342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aeaaa8-ba69-4602-b3f0-19431ef9236d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:27.838066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 598/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jul 20 15:17:27 2022] GET /identity/v3/projects/026162dc8df74e1491b6f5cdfebcb3ac => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:27.845561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d0c4b-9a6a-4d0f-99d2-e97c518dadc4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:17:27.964357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d0c4b-9a6a-4d0f-99d2-e97c518dadc4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:17:28.005088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a7be4-aa83-43a8-bc75-04f1a160a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:17:28.005737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7be4-aa83-43a8-bc75-04f1a160a962 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:17:28.006012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7be4-aa83-43a8-bc75-04f1a160a962 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:17:28.006292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7be4-aa83-43a8-bc75-04f1a160a962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:17:28.007178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a7be4-aa83-43a8-bc75-04f1a160a962 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=026162dc8df74e1491b6f5cdfebcb3ac, user.id=9561b2b6558a4705a1bd3870baf1d2da) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:17:28.007482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a7be4-aa83-43a8-bc75-04f1a160a962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:17:28.008927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a7be4-aa83-43a8-bc75-04f1a160a962 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:17:28.014868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 602/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:17:27 2022] GET /identity/v3/role_assignments?user.id=9561b2b6558a4705a1bd3870baf1d2da&scope.project.id=026162dc8df74e1491b6f5cdfebcb3ac&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:17:37.826082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=19 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:17:38.012282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:23.839021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c315-f10b-4bb7-89cb-b9af04568053 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:23.839021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c315-f10b-4bb7-89cb-b9af04568053 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:23.839021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c315-f10b-4bb7-89cb-b9af04568053 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:23.839841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 599/1201] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:23.845124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d023a-4304-4ac9-9555-c5cbd2aa8ff6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:23.845582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d023a-4304-4ac9-9555-c5cbd2aa8ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:23.845669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d023a-4304-4ac9-9555-c5cbd2aa8ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:23.863830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4b5d023a-4304-4ac9-9555-c5cbd2aa8ff6 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:23.865010 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4b5d023a-4304-4ac9-9555-c5cbd2aa8ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:23.940572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 603/1202] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:18:23.964601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105c315-f10b-4bb7-89cb-b9af04568053 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:24.082024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105c315-f10b-4bb7-89cb-b9af04568053 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:24.127259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:24.127999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:24.128378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:24.128726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:24.143267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:24.145110 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:24.168500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:24.169795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:24.171079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:24.171079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:24.171079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:24.171079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:24.171079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 600/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:24.176073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d023a-4304-4ac9-9555-c5cbd2aa8ff6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:24.320045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d023a-4304-4ac9-9555-c5cbd2aa8ff6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:24.357161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:24.365752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e76757-3d2b-43cc-9c80-672e1b3b5ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:24.366429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e76757-3d2b-43cc-9c80-672e1b3b5ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:24.366714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e76757-3d2b-43cc-9c80-672e1b3b5ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:24.367133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e76757-3d2b-43cc-9c80-672e1b3b5ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:24.367826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e76757-3d2b-43cc-9c80-672e1b3b5ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:24.368135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e76757-3d2b-43cc-9c80-672e1b3b5ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:24.369628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e76757-3d2b-43cc-9c80-672e1b3b5ec0 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:24.384108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 604/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:24.389558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:24.460702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:24.525766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95215599-7645-4426-ba9f-8be5056373f1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:24.572294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4233013-b3ee-4fa2-acf7-013448773259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:24.573114 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233013-b3ee-4fa2-acf7-013448773259 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:24.573349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233013-b3ee-4fa2-acf7-013448773259 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:24.573668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233013-b3ee-4fa2-acf7-013448773259 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:24.574602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4233013-b3ee-4fa2-acf7-013448773259 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:24.576053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4233013-b3ee-4fa2-acf7-013448773259 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:24.600312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 601/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jul 20 15:18:24 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:18:26.777386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961656a5-d03c-4a59-aeb6-5c859220116d None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:26.778073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961656a5-d03c-4a59-aeb6-5c859220116d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:26.778073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961656a5-d03c-4a59-aeb6-5c859220116d None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:26.779554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 605/1206] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:26.785313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed18c-d20b-49f7-bd78-9ff16119ad8a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:26.785927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed18c-d20b-49f7-bd78-9ff16119ad8a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:26.786136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed18c-d20b-49f7-bd78-9ff16119ad8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:26.803531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7e7ed18c-d20b-49f7-bd78-9ff16119ad8a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:26.804835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7e7ed18c-d20b-49f7-bd78-9ff16119ad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:26.887334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 602/1207] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:26.912663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961656a5-d03c-4a59-aeb6-5c859220116d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:27.037265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961656a5-d03c-4a59-aeb6-5c859220116d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:27.080396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc363f-8298-4ca5-a78a-74ca9313adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:27.081621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc363f-8298-4ca5-a78a-74ca9313adca None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:27.082106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc363f-8298-4ca5-a78a-74ca9313adca None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:27.082644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc363f-8298-4ca5-a78a-74ca9313adca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:27.095584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc363f-8298-4ca5-a78a-74ca9313adca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b0fc363f-8298-4ca5-a78a-74ca9313adca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:18:27.103770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:27.105371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:27.106262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 606/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:18:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:27.112875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed18c-d20b-49f7-bd78-9ff16119ad8a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:27.161779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:27.235730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed18c-d20b-49f7-bd78-9ff16119ad8a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:27.277157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:27.277907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:27.278188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:27.278462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:27.279406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:27.279725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:27.282353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:27.290384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 603/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:27.296757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc363f-8298-4ca5-a78a-74ca9313adca None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:27.348852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:27.413831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc363f-8298-4ca5-a78a-74ca9313adca None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:27.449596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:27.450332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:27.450587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:27.450883 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:27.461842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:27.463382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:27.481171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:27.482284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:27.483518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:27.483518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:27.483518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:27.483518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:27.485142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 607/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:18:27.491145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:27.611337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:27.614343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed994-4b81-49ac-a7ae-d7421516ccdd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:27.657752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:27.658616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:27.658929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:27.659230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:27.660155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:27.660469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:27.662128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:27.675713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 604/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:27.681869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:27.801304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7fa2-d314-44e7-85a6-b54f0168c0d4 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:27.802887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:27.838324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:27.839185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:27.839458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:27.839729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:27.848190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:27.849746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:18:27.865834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:27.866857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:27.868171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:27.871468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 608/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:27.872715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:27.997821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3487e25-f417-4821-aeaa-7ae795aa650a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:28.036643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:28.037324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:28.037612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:28.037863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:28.038702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:28.039035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:28.040573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:28.059335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 605/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jul 20 15:18:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:18:28.066416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:28.181945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbc35d-493c-4c99-a56a-6d6734ed3421 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:28.221955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75130-bfae-4d90-8d5d-d1925a91f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:28.223386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75130-bfae-4d90-8d5d-d1925a91f430 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:28.223386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75130-bfae-4d90-8d5d-d1925a91f430 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:28.223386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75130-bfae-4d90-8d5d-d1925a91f430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:28.257803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:28.301443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75130-bfae-4d90-8d5d-d1925a91f430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:28.303033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e75130-bfae-4d90-8d5d-d1925a91f430 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:28.412081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 609/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:18:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 15:18:28.418006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:28.443764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:28.530656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a79eed-990d-4390-94ba-4406ba9bd620 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:28.566054 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:28.566895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:28.567211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:28.567489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:28.580361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:28.582143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:28.600683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:28.602542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:28.603891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:28.603891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:28.603891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:28.603891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:28.609946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 606/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:28.611000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75130-bfae-4d90-8d5d-d1925a91f430 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:28.672879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:28.715515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75130-bfae-4d90-8d5d-d1925a91f430 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:28.749980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:28.750645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:28.750925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:28.751295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:28.752033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:28.752336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:28.753730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:28.766129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 610/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:28.771882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:28.847940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:28.885402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703b582-f461-4d1f-9e3b-68a35087fe2d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:28.930453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:28.931308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:28.931578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:28.931844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:28.939328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:28.943065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:18:28.957836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:28.959008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:28.959985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 607/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:28.965345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:29.069058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a0823-68d3-4247-9a69-070b0d8fc5ca None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:29.093474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:29.106240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd165d7-f2e5-4c44-b91b-e4ef9a2af26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:29.106807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd165d7-f2e5-4c44-b91b-e4ef9a2af26a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:29.107156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd165d7-f2e5-4c44-b91b-e4ef9a2af26a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:29.107334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd165d7-f2e5-4c44-b91b-e4ef9a2af26a None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:29.108149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd165d7-f2e5-4c44-b91b-e4ef9a2af26a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:29.108454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd165d7-f2e5-4c44-b91b-e4ef9a2af26a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:29.109910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd165d7-f2e5-4c44-b91b-e4ef9a2af26a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:29.123239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 611/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:18:29.129371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:29.251078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2f41-c8d7-458f-9bf4-cfbdf3cd775c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:29.286205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:29.293637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64966f0e-a047-4649-8bfa-9fbb1969328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:29.294363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966f0e-a047-4649-8bfa-9fbb1969328e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:29.294644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966f0e-a047-4649-8bfa-9fbb1969328e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:29.294910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64966f0e-a047-4649-8bfa-9fbb1969328e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:29.295769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64966f0e-a047-4649-8bfa-9fbb1969328e None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=bbd510b41d234c96bb43fc1921c8604f) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:29.296124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64966f0e-a047-4649-8bfa-9fbb1969328e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:29.297562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64966f0e-a047-4649-8bfa-9fbb1969328e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:29.314994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 608/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:18:29 2022] GET /identity/v3/role_assignments?user.id=bbd510b41d234c96bb43fc1921c8604f&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:31.335428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ddac-cefc-4116-b301-787671dba5fc None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:31.336003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ddac-cefc-4116-b301-787671dba5fc None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:31.336003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ddac-cefc-4116-b301-787671dba5fc None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:31.337272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 612/1220] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:31.342607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8481-5dbb-4586-8598-3737cabb249d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:31.343152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8481-5dbb-4586-8598-3737cabb249d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:31.343152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8481-5dbb-4586-8598-3737cabb249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:31.360536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-91de8481-5dbb-4586-8598-3737cabb249d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:31.361758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-91de8481-5dbb-4586-8598-3737cabb249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:31.434835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 609/1221] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:31.458731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009ddac-cefc-4116-b301-787671dba5fc None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:31.574459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009ddac-cefc-4116-b301-787671dba5fc None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:31.611465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17fb1b-46e9-4d82-89f5-6dd83018207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:31.612183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17fb1b-46e9-4d82-89f5-6dd83018207d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:31.612467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17fb1b-46e9-4d82-89f5-6dd83018207d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:31.612741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17fb1b-46e9-4d82-89f5-6dd83018207d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:31.624725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17fb1b-46e9-4d82-89f5-6dd83018207d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-1b17fb1b-46e9-4d82-89f5-6dd83018207d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:18:31.633272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:31.634499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:31.635580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 613/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:31.641276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de8481-5dbb-4586-8598-3737cabb249d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:31.755620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de8481-5dbb-4586-8598-3737cabb249d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:31.779405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:31.792543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:31.793220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:31.793499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:31.793776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:31.794530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:31.794835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:31.796275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:31.804994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 610/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:31.811225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17fb1b-46e9-4d82-89f5-6dd83018207d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:31.859347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:31.920817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17fb1b-46e9-4d82-89f5-6dd83018207d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:31.959613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:31.960496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:31.960782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:31.961055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:31.973176 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:31.975134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:31.994308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:31.996065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:31.997237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:31.997237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:31.997237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:31.997237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:31.997237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 614/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:32.002442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:32.113856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be255d92-16f5-47d1-8f4f-d200516f353a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:32.152756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:32.153497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:32.153804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:32.154122 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:32.155017 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:32.155391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:32.156895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:32.172735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 611/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:18:32.178649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:32.286932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:32.294923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9007822-3df0-4439-80a3-9dd044f77bc8 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:32.329651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:32.330539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:32.330758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:32.331035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:32.338808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:32.340387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:18:32.354778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:32.355984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:32.361984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 615/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:32.363200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:32.420384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:32.477362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe230b-9e3a-4ceb-aa82-525a8efcf071 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:32.517998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:32.518848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:32.519254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:32.519622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:32.520561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:32.520964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:32.522509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:32.539759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 612/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jul 20 15:18:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:32.546218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:32.650813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447f112-2609-4dac-874a-b017d0f33ebb None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:32.692534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:32.693410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:32.693818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:32.694210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:32.707429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:32.709104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:32.726560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:32.727785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:32.733680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:32.733680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:32.733680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:32.733680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:32.733680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 616/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:18:32.735178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:32.840980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23b0a-5d2f-44ca-bd3b-9ee5ae50ac54 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:32.843418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:32.876200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:32.876871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:32.877150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:32.877422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:32.878178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:32.878481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:32.879965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:32.896663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 613/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:32.898007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:32.907845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:33.012381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f615c-2ae8-4787-8082-585850bfb346 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:33.055021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:33.056019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:33.056445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:33.056813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:33.065074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:33.066688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:18:33.082477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:33.083660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:33.084583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 617/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:33.089825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:33.204168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76d7a-13de-4e94-beef-62e8550220d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:33.242677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3ae8-7569-42f8-bfe6-ff4fc7e20362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:33.243448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3ae8-7569-42f8-bfe6-ff4fc7e20362 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:33.243816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3ae8-7569-42f8-bfe6-ff4fc7e20362 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:33.244135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3ae8-7569-42f8-bfe6-ff4fc7e20362 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:33.245402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3ae8-7569-42f8-bfe6-ff4fc7e20362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:33.245721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3ae8-7569-42f8-bfe6-ff4fc7e20362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:33.247449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3ae8-7569-42f8-bfe6-ff4fc7e20362 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:33.260366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 614/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:18:33.267231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:33.349923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:33.389572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c9e4c-c2e4-44e7-a261-1949e6915499 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:33.426673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa7c3-fd40-4059-8033-6ae10df75fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:33.427730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa7c3-fd40-4059-8033-6ae10df75fd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:33.428099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa7c3-fd40-4059-8033-6ae10df75fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:33.428400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa7c3-fd40-4059-8033-6ae10df75fd9 None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/bbd510b41d234c96bb43fc1921c8604f/roles/8a313a6550f146259cb001349ea432d9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:33.445421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa7c3-fd40-4059-8033-6ae10df75fd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=bbd510b41d234c96bb43fc1921c8604f, role_id=8a313a6550f146259cb001349ea432d9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:33.446885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa7c3-fd40-4059-8033-6ae10df75fd9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:33.460675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 618/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:18:33 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/bbd510b41d234c96bb43fc1921c8604f/roles/8a313a6550f146259cb001349ea432d9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:18:35.663002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b79d8-9e83-4e6b-9605-7f739ddafa78 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:35.663002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b79d8-9e83-4e6b-9605-7f739ddafa78 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:35.663002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b79d8-9e83-4e6b-9605-7f739ddafa78 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:35.664438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 615/1233] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:35.670736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb542f-5b2d-4422-a83f-be269d859b77 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:35.671304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb542f-5b2d-4422-a83f-be269d859b77 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:35.671416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb542f-5b2d-4422-a83f-be269d859b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:35.695394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-94fb542f-5b2d-4422-a83f-be269d859b77 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:35.696670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94fb542f-5b2d-4422-a83f-be269d859b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:35.783578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 619/1234] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:35.807671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b79d8-9e83-4e6b-9605-7f739ddafa78 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:35.833343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:35.912049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b79d8-9e83-4e6b-9605-7f739ddafa78 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:35.949683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec30d3-48a9-4534-8bfa-ad5e1b08425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:35.950499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec30d3-48a9-4534-8bfa-ad5e1b08425a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:35.950778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec30d3-48a9-4534-8bfa-ad5e1b08425a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:35.951099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec30d3-48a9-4534-8bfa-ad5e1b08425a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:35.964743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec30d3-48a9-4534-8bfa-ad5e1b08425a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e3ec30d3-48a9-4534-8bfa-ad5e1b08425a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:18:35.972563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:35.973604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:35.974439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 616/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jul 20 15:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:35.981121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb542f-5b2d-4422-a83f-be269d859b77 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:36.032743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:36.090566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb542f-5b2d-4422-a83f-be269d859b77 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:36.128129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47195ad-038e-4238-854a-60733654239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:36.128825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47195ad-038e-4238-854a-60733654239a None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:36.129109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47195ad-038e-4238-854a-60733654239a None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:36.129382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47195ad-038e-4238-854a-60733654239a None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:36.130160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47195ad-038e-4238-854a-60733654239a None admin] RBAC: Adding query filter params (name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:36.130462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47195ad-038e-4238-854a-60733654239a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:36.131909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47195ad-038e-4238-854a-60733654239a None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:36.140261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 620/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jul 20 15:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:18:36.146133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec30d3-48a9-4534-8bfa-ad5e1b08425a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:36.239279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:36.258781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec30d3-48a9-4534-8bfa-ad5e1b08425a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:36.293771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:36.294583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:36.294866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:36.295178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:36.307166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:36.308787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:36.326446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:36.327673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:36.328959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:36.328959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:36.328959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:36.328959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:36.328959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 617/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:36.334110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47195ad-038e-4238-854a-60733654239a None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:36.444564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47195ad-038e-4238-854a-60733654239a None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:36.453959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:36.481795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:36.482622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:36.482917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:36.483232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:36.484085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:36.484420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:36.486166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:36.500625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 621/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:36.506892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:36.618914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe075c-876b-443c-9296-3c4084a69eb5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:36.656455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:36.657289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:36.657570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:36.657864 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:36.660803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:36.667786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:36.669806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:18:36.687600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:36.689077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:36.690351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 618/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:36.695183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:36.801963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ffbe6-4db3-4fe7-9959-08f7a75457fc None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:36.839597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:36.840280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:36.840567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:36.840846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:36.841686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:36.841996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:36.843492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:36.861839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 622/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jul 20 15:18:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:36.867888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:36.975581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d7fee-a0c6-4c26-a910-d01ac12eaef9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:37.016300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c60477-dab7-491d-b0db-6a3792c67108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:37.016956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c60477-dab7-491d-b0db-6a3792c67108 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:37.017239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c60477-dab7-491d-b0db-6a3792c67108 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:37.017515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c60477-dab7-491d-b0db-6a3792c67108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:37.084435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:37.093364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c60477-dab7-491d-b0db-6a3792c67108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:37.095162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c60477-dab7-491d-b0db-6a3792c67108 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:37.202558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 619/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:18:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:18:37.210083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:37.241143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:37.320765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823efc5-2ba4-41af-b174-7e8bbbb5f84f None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:37.361343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:37.362207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:37.362458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:37.362800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:37.380514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:37.382081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:37.413948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:37.415116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:37.416212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:37.416212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:37.416212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:37.416212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:37.416212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 623/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:37.421340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c60477-dab7-491d-b0db-6a3792c67108 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:37.524313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:37.530462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c60477-dab7-491d-b0db-6a3792c67108 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:37.568293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:37.568998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:37.569305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:37.569617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:37.570345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:37.570654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:37.572124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:37.584352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 620/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:37.590636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:37.682145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:37.712016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49b01e-70c8-4fc6-84a6-1dd0b19bf0de None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:37.754712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:37.755719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:37.756075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:37.756415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:37.763566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:37.765036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:18:37.778900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:37.779792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:37.780671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:18:37.780671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:18:37.780671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:18:37.780671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:18:37.780671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:18:37.780671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:18:37.780671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:37.780671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:37.783165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 624/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:37.786836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:37.896650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a61c0-d1b9-4914-a5ee-f624b03ed7d9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:37.933700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81315e-f2e0-4ade-b15f-4037e9ac8130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:37.934283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81315e-f2e0-4ade-b15f-4037e9ac8130 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:37.934562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81315e-f2e0-4ade-b15f-4037e9ac8130 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:37.934834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81315e-f2e0-4ade-b15f-4037e9ac8130 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:37.935678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81315e-f2e0-4ade-b15f-4037e9ac8130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:37.936005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81315e-f2e0-4ade-b15f-4037e9ac8130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:37.937501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81315e-f2e0-4ade-b15f-4037e9ac8130 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:37.952679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 621/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:37.959820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:38.075960 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9e99a-b40d-475e-ba3e-673bfa5ea4dd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:38.112869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bff70-b4cd-45a0-95b0-c7a1f9c6718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:38.113556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bff70-b4cd-45a0-95b0-c7a1f9c6718f None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:38.113843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bff70-b4cd-45a0-95b0-c7a1f9c6718f None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:38.114113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bff70-b4cd-45a0-95b0-c7a1f9c6718f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:38.115059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bff70-b4cd-45a0-95b0-c7a1f9c6718f None admin] RBAC: Adding query filter params (role.id=8a313a6550f146259cb001349ea432d9, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=bbd510b41d234c96bb43fc1921c8604f) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:38.115366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bff70-b4cd-45a0-95b0-c7a1f9c6718f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:38.116809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bff70-b4cd-45a0-95b0-c7a1f9c6718f None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:38.123302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 625/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:18:37 2022] GET /identity/v3/role_assignments?user.id=bbd510b41d234c96bb43fc1921c8604f&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=8a313a6550f146259cb001349ea432d9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:40.379297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a527f-843e-4391-a1a8-2017bb741b49 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:40.379826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a527f-843e-4391-a1a8-2017bb741b49 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:40.379826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a527f-843e-4391-a1a8-2017bb741b49 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:40.381233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 622/1247] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:40.387007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4441-3046-4421-8e8c-14d901539957 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:40.387484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4441-3046-4421-8e8c-14d901539957 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:40.387562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd4441-3046-4421-8e8c-14d901539957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:40.392840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:40.411245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-55cd4441-3046-4421-8e8c-14d901539957 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:40.412644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-55cd4441-3046-4421-8e8c-14d901539957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:40.489048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 626/1248] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:40.516210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a527f-843e-4391-a1a8-2017bb741b49 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:40.537353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:40.629990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a527f-843e-4391-a1a8-2017bb741b49 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:40.666058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada785e5-ac6d-49a9-86f2-335941204358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:40.666907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada785e5-ac6d-49a9-86f2-335941204358 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:40.667225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada785e5-ac6d-49a9-86f2-335941204358 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:40.667482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada785e5-ac6d-49a9-86f2-335941204358 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:40.679857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada785e5-ac6d-49a9-86f2-335941204358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ada785e5-ac6d-49a9-86f2-335941204358 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:18:40.688709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:40.690032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:40.691205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 623/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:18:40.696512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd4441-3046-4421-8e8c-14d901539957 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:40.828787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd4441-3046-4421-8e8c-14d901539957 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:40.865374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:40.871809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:40.872532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:40.872813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:40.873077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:40.873910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:40.874226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:40.875668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:40.885521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 627/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:40.891503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada785e5-ac6d-49a9-86f2-335941204358 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:40.977987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:41.002587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada785e5-ac6d-49a9-86f2-335941204358 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:41.041123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:41.041940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:41.042218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:41.042532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:41.054871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:41.056504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:41.075928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:41.077115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:41.078665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:41.078665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:41.078665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:41.078665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:41.078665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 624/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:41.083231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:41.205147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa041b-b21b-4a1b-be6c-18fd857860b7 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:41.247758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:41.248992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:41.249409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:41.249792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:41.250842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:41.251334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:41.253028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:41.267617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 628/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:41.273918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:41.394205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd5b2b-cd2f-40eb-9b16-12aa1be88add None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:41.422993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:41.433590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:41.434415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:41.434692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:41.434983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:41.443278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:41.444738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:18:41.460454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:41.461619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:41.462621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 625/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:41.467708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:41.530860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:41.583141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4b12-2459-4b8b-b814-6766b2dffa7b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:41.621387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:41.622095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:41.622372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:41.622640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:41.623502 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:41.623808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:41.625524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:41.644576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 629/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jul 20 15:18:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:41.650549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:41.767861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa004-2a2d-4fcb-a2d8-0b9216dac808 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:41.806687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450869e-854c-43ee-bfd5-5f8d1bc7e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:41.807481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450869e-854c-43ee-bfd5-5f8d1bc7e212 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:41.807762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450869e-854c-43ee-bfd5-5f8d1bc7e212 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:41.808079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450869e-854c-43ee-bfd5-5f8d1bc7e212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:41.872605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:41.887304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450869e-854c-43ee-bfd5-5f8d1bc7e212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:41.888997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450869e-854c-43ee-bfd5-5f8d1bc7e212 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:42.003655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 626/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:18:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:18:42.009716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:42.128545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fd71-731b-43e6-8026-bcc3bc94154b None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:42.144188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:42.168559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:42.169366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:42.169645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:42.169943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:42.181725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:42.183241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:42.202140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:42.203398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:42.204688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:42.204688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:42.204688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:42.204688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:42.204688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 630/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:42.209520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450869e-854c-43ee-bfd5-5f8d1bc7e212 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:42.309307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:42.322936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450869e-854c-43ee-bfd5-5f8d1bc7e212 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:42.359208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:42.359878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:42.360155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:42.360425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:42.361156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:42.361457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:42.363062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:42.375386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 627/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:42.381606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:42.498286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6758287-cce9-4e09-94cc-4e7a9f24660d None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:42.535035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:42.535964 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:42.536296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:42.536736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:42.544199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:42.547289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:18:42.564036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:42.565239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:42.571453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 631/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:18:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:42.571960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:42.682240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826380d-6d93-4862-8377-63f93a05aff9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:42.734176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc40030-1145-42a2-a6ad-119ead82e1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:42.734859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40030-1145-42a2-a6ad-119ead82e1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:42.735173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40030-1145-42a2-a6ad-119ead82e1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:42.735452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40030-1145-42a2-a6ad-119ead82e1a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:42.736262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc40030-1145-42a2-a6ad-119ead82e1a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:42.736576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc40030-1145-42a2-a6ad-119ead82e1a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:42.738050 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc40030-1145-42a2-a6ad-119ead82e1a1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:42.752071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 628/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:42.758574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:42.785820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:42.867421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd9240-a155-4911-a366-c6c018a8dd89 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:42.905890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1337-b1ff-433d-941e-743b0167d6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:42.906629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1337-b1ff-433d-941e-743b0167d6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:42.906928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1337-b1ff-433d-941e-743b0167d6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:42.907241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1337-b1ff-433d-941e-743b0167d6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:42.908094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1337-b1ff-433d-941e-743b0167d6f9 None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=bbd510b41d234c96bb43fc1921c8604f) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:42.908406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1337-b1ff-433d-941e-743b0167d6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:42.909867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1337-b1ff-433d-941e-743b0167d6f9 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:42.915962 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 632/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:18:42 2022] GET /identity/v3/role_assignments?user.id=bbd510b41d234c96bb43fc1921c8604f&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:44.929363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c85d4b-c489-4176-85ce-aa3c92bf7898 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:44.929962 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c85d4b-c489-4176-85ce-aa3c92bf7898 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:44.929962 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c85d4b-c489-4176-85ce-aa3c92bf7898 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:44.931316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 629/1261] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:44.938091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6cae-afd7-4255-b4f6-d39b80a62057 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:44.938762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6cae-afd7-4255-b4f6-d39b80a62057 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:44.939391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a6cae-afd7-4255-b4f6-d39b80a62057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:44.965484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3f5a6cae-afd7-4255-b4f6-d39b80a62057 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:44.966696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3f5a6cae-afd7-4255-b4f6-d39b80a62057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:45.042106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 633/1262] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:45.065393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c85d4b-c489-4176-85ce-aa3c92bf7898 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:45.077037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:45.188226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c85d4b-c489-4176-85ce-aa3c92bf7898 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:45.224038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4403-a7fe-4e31-b464-5207d9afdb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:45.224826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4403-a7fe-4e31-b464-5207d9afdb9e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:45.225106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4403-a7fe-4e31-b464-5207d9afdb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:45.225376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4403-a7fe-4e31-b464-5207d9afdb9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:45.236461 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4403-a7fe-4e31-b464-5207d9afdb9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-760b4403-a7fe-4e31-b464-5207d9afdb9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:18:45.244354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:45.245734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:45.246576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 630/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:18:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:45.253895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a6cae-afd7-4255-b4f6-d39b80a62057 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:45.273649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:45.369094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a6cae-afd7-4255-b4f6-d39b80a62057 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:45.405078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:45.405739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:45.406020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:45.406294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:45.407066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:45.407376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:45.408762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:45.417862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 634/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:18:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:45.426412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4403-a7fe-4e31-b464-5207d9afdb9e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:45.495627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:45.534048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4403-a7fe-4e31-b464-5207d9afdb9e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:45.575703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:45.576778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:45.577057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:45.577323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:45.589854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:45.591357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:45.617205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:45.618221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:45.619246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:45.619246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:45.619246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:45.619246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:45.619246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 631/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:45.626578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:45.724174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:45.750094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b3bc-1d5b-452a-8fa8-335cb996c952 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:45.789084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:45.789749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:45.790030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:45.790288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:45.791031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:45.791365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:45.792744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:45.805765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 635/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:45.812748 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:45.954505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101a47a-012a-4cdf-8588-bbeb042e39f9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:45.989967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:46.010741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:46.011501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:46.011775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:46.012039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:46.019740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:46.021183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:18:46.035512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:46.037214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:46.038500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 632/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:46.044250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:46.150288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a335-4d25-41ea-8c6b-396739173fb6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:46.191118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:46.191776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:46.192051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:46.192321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:46.193155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:46.193482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:46.194910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:46.203748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:46.212677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 636/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jul 20 15:18:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:46.218633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:46.330984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627615b-969c-4cf0-87d3-076abd7e13e4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:46.375685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794193-a593-4267-975d-b96e893ae90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:46.376848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794193-a593-4267-975d-b96e893ae90c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:46.377233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794193-a593-4267-975d-b96e893ae90c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:46.377615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794193-a593-4267-975d-b96e893ae90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:46.389656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27794193-a593-4267-975d-b96e893ae90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:46.391167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27794193-a593-4267-975d-b96e893ae90c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-27794193-a593-4267-975d-b96e893ae90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:46.408505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:46.409593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:46.410842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:46.410842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:46.410842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:46.410842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:46.410842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 633/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:46.415783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:46.533457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385fc9-186d-483e-b69f-01f00826ebbd None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:46.577118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178552c-e442-4967-bf10-0155b068abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:46.577779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178552c-e442-4967-bf10-0155b068abce None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:46.578058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178552c-e442-4967-bf10-0155b068abce None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:46.578331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178552c-e442-4967-bf10-0155b068abce None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:46.579095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178552c-e442-4967-bf10-0155b068abce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:46.579400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178552c-e442-4967-bf10-0155b068abce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:46.580794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178552c-e442-4967-bf10-0155b068abce None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:46.592392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 637/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:46.601054 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794193-a593-4267-975d-b96e893ae90c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:46.639643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:46.728909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794193-a593-4267-975d-b96e893ae90c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:46.767854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:46.768653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:46.768935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:46.769202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:46.776199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:46.777656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:18:46.792007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:46.793043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:46.794180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 634/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:46.799495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178552c-e442-4967-bf10-0155b068abce None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:46.861999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:46.907071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178552c-e442-4967-bf10-0155b068abce None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:46.941812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71c1f9-eec3-4fe4-b296-a6524cb43af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:46.942467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71c1f9-eec3-4fe4-b296-a6524cb43af7 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:46.942718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71c1f9-eec3-4fe4-b296-a6524cb43af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:46.943026 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71c1f9-eec3-4fe4-b296-a6524cb43af7 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:46.943801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71c1f9-eec3-4fe4-b296-a6524cb43af7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:46.944122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71c1f9-eec3-4fe4-b296-a6524cb43af7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:46.945587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71c1f9-eec3-4fe4-b296-a6524cb43af7 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:46.958877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 638/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:18:46.965729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:47.066998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:47.083441 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27218a2d-7a8c-4ef8-ba69-847b331cee55 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:47.125084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664842db-a1dc-4467-9926-3c8f73bcd81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:47.125917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664842db-a1dc-4467-9926-3c8f73bcd81c None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:47.126202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664842db-a1dc-4467-9926-3c8f73bcd81c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:47.126476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664842db-a1dc-4467-9926-3c8f73bcd81c None admin] PATH_INFO: `/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/bbd510b41d234c96bb43fc1921c8604f/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:47.128518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664842db-a1dc-4467-9926-3c8f73bcd81c None admin] RBAC: Authorizing `identity:create_grant(project_id=c9625d8f2e12425f8aa9921ca7d5be50, user_id=bbd510b41d234c96bb43fc1921c8604f, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:47.130034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664842db-a1dc-4467-9926-3c8f73bcd81c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:47.147734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 635/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jul 20 15:18:46 2022] PUT /identity/v3/projects/c9625d8f2e12425f8aa9921ca7d5be50/users/bbd510b41d234c96bb43fc1921c8604f/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:18:49.190165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee956-5d17-4b93-88fa-9cdc7a5dc82e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:49.191168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee956-5d17-4b93-88fa-9cdc7a5dc82e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:49.191168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee956-5d17-4b93-88fa-9cdc7a5dc82e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:49.192819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 639/1274] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:49.199895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d54a-2b5b-4817-8a53-a40377f9004b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:49.200661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d54a-2b5b-4817-8a53-a40377f9004b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:49.200661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d54a-2b5b-4817-8a53-a40377f9004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:49.226657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a9b2d54a-2b5b-4817-8a53-a40377f9004b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:49.227882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a9b2d54a-2b5b-4817-8a53-a40377f9004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:49.307699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 636/1275] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:49.335324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee956-5d17-4b93-88fa-9cdc7a5dc82e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:49.450816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee956-5d17-4b93-88fa-9cdc7a5dc82e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:49.468965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:49.488850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dadf78-b8b8-4714-a2ac-f149a302ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:49.489651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dadf78-b8b8-4714-a2ac-f149a302ce58 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:49.489950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dadf78-b8b8-4714-a2ac-f149a302ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:49.490223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dadf78-b8b8-4714-a2ac-f149a302ce58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:49.502272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dadf78-b8b8-4714-a2ac-f149a302ce58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-63dadf78-b8b8-4714-a2ac-f149a302ce58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:18:49.510377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:49.511573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:49.512654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 640/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jul 20 15:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:49.518229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2d54a-2b5b-4817-8a53-a40377f9004b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:49.604210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:49.626728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2d54a-2b5b-4817-8a53-a40377f9004b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:49.664591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:49.665255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:49.665567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:49.665835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:49.666580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:49.666889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:49.668302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:49.677644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 637/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jul 20 15:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:49.684633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dadf78-b8b8-4714-a2ac-f149a302ce58 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:49.791239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dadf78-b8b8-4714-a2ac-f149a302ce58 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:49.829493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:49.830277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:49.830551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:49.830823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:49.841967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:49.843469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:49.860840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:49.861859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:49.862888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:49.862888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:49.862888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:49.862888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:49.862888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 641/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:49.868197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:49.982744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e146a40-1dcb-4fc2-9d4a-d0447dd77c21 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:50.019168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:50.019876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:50.020157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:50.020398 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:50.021150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:50.021458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:50.022838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:50.035896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 638/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:50.042066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:50.077592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:50.151943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14713cc8-19b5-4d47-a556-f57cc95ec203 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:50.190680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:50.191748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:50.192008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:50.192304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:50.200378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:50.201824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:18:50.216728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:50.218289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:50.220257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 642/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:50.227465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:50.231875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:50.336972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5b1cc-8d0e-418d-a3f0-ae26123d332b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:50.374655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:50.375356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:50.375637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:50.375912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:50.376753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:50.377057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:50.378501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:50.395294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 639/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jul 20 15:18:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:50.404069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:50.500242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:50.512020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956fc69-d7a6-4573-bf99-08db6f37d378 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:50.547890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cfd31-42a2-4cc5-bdfc-d6aaf6710b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:50.548537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cfd31-42a2-4cc5-bdfc-d6aaf6710b09 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:50.548813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cfd31-42a2-4cc5-bdfc-d6aaf6710b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:50.549086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cfd31-42a2-4cc5-bdfc-d6aaf6710b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:50.619007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cfd31-42a2-4cc5-bdfc-d6aaf6710b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:50.620765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cfd31-42a2-4cc5-bdfc-d6aaf6710b09 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:50.719020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:50.730604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 643/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jul 20 15:18:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 15:18:50.736842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:50.801733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:50.851968 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28708adb-eaf9-4cb7-b7f9-593c02b1bbde None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:50.888158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:50.888891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:50.889169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:50.889438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:50.899985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:50.901446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:18:50.919306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:50.920319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:50.921579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:18:50.921579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:18:50.921579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:18:50.921579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:50.921579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 640/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:50.927982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cfd31-42a2-4cc5-bdfc-d6aaf6710b09 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:51.038521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cfd31-42a2-4cc5-bdfc-d6aaf6710b09 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:51.074223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:51.074876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:51.075200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:51.075483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:51.076197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:51.076501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:51.077922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:51.089399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 644/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jul 20 15:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:51.095436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:51.212206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d27232-1cd2-48e1-b1c0-a86f740bfea1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:51.226073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:51.247903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:51.248706 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:51.248984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:51.249252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:51.256636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:51.258101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:18:51.272105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:51.273131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 20 15:18:51.274335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 641/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jul 20 15:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:18:51.279423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:51.333032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:51.387601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032560f7-8f5d-466f-a156-734711c3bf09 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:51.432736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcf68e-7844-4034-9d4e-f5f298fb8919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:51.433390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcf68e-7844-4034-9d4e-f5f298fb8919 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:51.433670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcf68e-7844-4034-9d4e-f5f298fb8919 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:51.433914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcf68e-7844-4034-9d4e-f5f298fb8919 None admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:51.434748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcf68e-7844-4034-9d4e-f5f298fb8919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:51.435089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcf68e-7844-4034-9d4e-f5f298fb8919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:51.436535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcf68e-7844-4034-9d4e-f5f298fb8919 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:51.448962 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 645/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jul 20 15:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:51.457267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:51.572433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1ed4-5170-4b5e-9193-67ad7f6aea73 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:51.609060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2da7e-f70b-454a-a2a7-7b0a344de76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:51.609703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2da7e-f70b-454a-a2a7-7b0a344de76e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:51.609984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2da7e-f70b-454a-a2a7-7b0a344de76e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:51.610260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2da7e-f70b-454a-a2a7-7b0a344de76e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:51.611106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2da7e-f70b-454a-a2a7-7b0a344de76e None admin] RBAC: Adding query filter params (role.id=f90ad41cff42473fb69ee5af3b163368, scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50, user.id=bbd510b41d234c96bb43fc1921c8604f) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:51.611421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2da7e-f70b-454a-a2a7-7b0a344de76e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:51.612876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2da7e-f70b-454a-a2a7-7b0a344de76e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:51.618900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 642/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jul 20 15:18:51 2022] GET /identity/v3/role_assignments?user.id=bbd510b41d234c96bb43fc1921c8604f&scope.project.id=c9625d8f2e12425f8aa9921ca7d5be50&role.id=f90ad41cff42473fb69ee5af3b163368 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:53.676665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8e5f-1d97-4c8d-a818-3f8c4b4cec7e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:53.677476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8e5f-1d97-4c8d-a818-3f8c4b4cec7e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:53.677641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8e5f-1d97-4c8d-a818-3f8c4b4cec7e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:53.680428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 646/1288] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:53.687650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f7779-0e90-46db-b811-731927ab28dc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:53.688123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f7779-0e90-46db-b811-731927ab28dc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:53.688215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f7779-0e90-46db-b811-731927ab28dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:53.707360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9b4f7779-0e90-46db-b811-731927ab28dc None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:53.708834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9b4f7779-0e90-46db-b811-731927ab28dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:53.747953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:53.786666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 643/1289] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:53.809690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab8e5f-1d97-4c8d-a818-3f8c4b4cec7e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:53.918869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab8e5f-1d97-4c8d-a818-3f8c4b4cec7e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:53.929357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:53.961456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:53.962291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:53.962570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:53.962839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:53.963533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:53.964959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:53.976972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:53.978133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:53.979337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 647/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:18:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:53.984534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f7779-0e90-46db-b811-731927ab28dc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:54.107361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f7779-0e90-46db-b811-731927ab28dc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:54.143220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b6c89-68f1-4228-95f3-bc5d991eeb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:54.143883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b6c89-68f1-4228-95f3-bc5d991eeb25 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:54.144163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b6c89-68f1-4228-95f3-bc5d991eeb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:54.144756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b6c89-68f1-4228-95f3-bc5d991eeb25 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:54.145459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b6c89-68f1-4228-95f3-bc5d991eeb25 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:54.145760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b6c89-68f1-4228-95f3-bc5d991eeb25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:54.147181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b6c89-68f1-4228-95f3-bc5d991eeb25 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:54.152152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 644/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Jul 20 15:18:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:54.158868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:54.273490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aa4c8-8897-4f6d-90e7-c4abf1bf3fd5 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:54.307949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec7c5-4a86-452f-974e-8187a69229c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:54.308631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec7c5-4a86-452f-974e-8187a69229c8 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:54.308935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec7c5-4a86-452f-974e-8187a69229c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:54.309203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec7c5-4a86-452f-974e-8187a69229c8 None admin] PATH_INFO: `/v3/services` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:54.309904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec7c5-4a86-452f-974e-8187a69229c8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:54.310201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec7c5-4a86-452f-974e-8187a69229c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:54.311613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec7c5-4a86-452f-974e-8187a69229c8 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:54.316375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 648/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Jul 20 15:18:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:56.353727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ef7ba-f46a-4939-abe6-ffadd75a1271 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:56.354563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ef7ba-f46a-4939-abe6-ffadd75a1271 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:56.354563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ef7ba-f46a-4939-abe6-ffadd75a1271 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:56.356728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 645/1293] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:56.362483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aadbb-276b-4458-89b6-f575aeb8113f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:56.362903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aadbb-276b-4458-89b6-f575aeb8113f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:56.363078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aadbb-276b-4458-89b6-f575aeb8113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:56.382587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-135aadbb-276b-4458-89b6-f575aeb8113f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:56.383908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-135aadbb-276b-4458-89b6-f575aeb8113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:56.420551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:56.471741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 649/1294] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:56.494845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ef7ba-f46a-4939-abe6-ffadd75a1271 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:56.528902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:56.604955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ef7ba-f46a-4939-abe6-ffadd75a1271 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:56.641032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0347b73-15a7-4615-9012-4e96192c0557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:56.641685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0347b73-15a7-4615-9012-4e96192c0557 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:56.641959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0347b73-15a7-4615-9012-4e96192c0557 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:56.642226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0347b73-15a7-4615-9012-4e96192c0557 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:56.642936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0347b73-15a7-4615-9012-4e96192c0557 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:56.644338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0347b73-15a7-4615-9012-4e96192c0557 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:56.663517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 646/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jul 20 15:18:56 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:18:58.799483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180248-30eb-4088-af2d-310eada13389 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:58.800090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180248-30eb-4088-af2d-310eada13389 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:58.800090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180248-30eb-4088-af2d-310eada13389 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:58.801505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 650/1296] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:18:58.808000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1cf9-4d6d-4487-8ff6-e49d26021513 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:58.808771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1cf9-4d6d-4487-8ff6-e49d26021513 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:58.808925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1cf9-4d6d-4487-8ff6-e49d26021513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:58.830179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-997d1cf9-4d6d-4487-8ff6-e49d26021513 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:18:58.831431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-997d1cf9-4d6d-4487-8ff6-e49d26021513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:18:58.910810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 647/1297] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:18:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:18:58.934344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4180248-30eb-4088-af2d-310eada13389 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:59.047700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4180248-30eb-4088-af2d-310eada13389 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:59.084009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:59.084749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:59.085023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:59.085300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:59.085975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:59.087504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:18:59.100368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:18:59.101448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:18:59.102506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 651/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:18:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:18:59.108078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1cf9-4d6d-4487-8ff6-e49d26021513 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:59.128834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:59.217000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1cf9-4d6d-4487-8ff6-e49d26021513 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:59.256237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:59.256940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:59.257223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:59.257516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:59.258261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:59.258567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:59.260153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:59.265647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 648/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Jul 20 15:18:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:59.272231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:59.306523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:59.389528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983340c1-7a20-4a43-b596-ccf2675bf8a6 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:59.424051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4af9f2-01ac-409c-b3c8-674e5058938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:59.424694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af9f2-01ac-409c-b3c8-674e5058938c None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:59.424967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af9f2-01ac-409c-b3c8-674e5058938c None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:59.425239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af9f2-01ac-409c-b3c8-674e5058938c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:59.426029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4af9f2-01ac-409c-b3c8-674e5058938c None admin] RBAC: Adding query filter params (interface=public, service_id=2b3039771e7b47a381620e962ebd42c7, region_id=RegionOne) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:18:59.426331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4af9f2-01ac-409c-b3c8-674e5058938c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:59.427831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4af9f2-01ac-409c-b3c8-674e5058938c None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:59.434703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 652/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jul 20 15:18:59 2022] GET /identity/v3/endpoints?service_id=2b3039771e7b47a381620e962ebd42c7&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:18:59.443374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:18:59.530277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:18:59.557150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f6a76-e189-4621-8ce7-2d642f75fbdb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:18:59.596260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12b30-79fa-4bae-973d-33695ca22eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:18:59.596981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12b30-79fa-4bae-973d-33695ca22eba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:18:59.597266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12b30-79fa-4bae-973d-33695ca22eba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:18:59.597504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12b30-79fa-4bae-973d-33695ca22eba None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:18:59.598253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c12b30-79fa-4bae-973d-33695ca22eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:18:59.599860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c12b30-79fa-4bae-973d-33695ca22eba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:18:59.606998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 649/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jul 20 15:18:59 2022] GET /identity/v3/services => generated 2191 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:19:01.610295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9381-6e87-4ef6-b2a6-35852690de61 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:19:01.611218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9381-6e87-4ef6-b2a6-35852690de61 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:19:01.611218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9381-6e87-4ef6-b2a6-35852690de61 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:19:01.613425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 653/1302] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:19:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:19:01.619802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9970-f5c8-4916-affd-21ab8e425dfd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:19:01.620575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9970-f5c8-4916-affd-21ab8e425dfd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:19:01.620674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9970-f5c8-4916-affd-21ab8e425dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:19:01.647470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-605b9970-f5c8-4916-affd-21ab8e425dfd None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:19:01.648650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-605b9970-f5c8-4916-affd-21ab8e425dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:19:01.722217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 650/1303] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:19:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:19:01.745766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca9381-6e87-4ef6-b2a6-35852690de61 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:19:01.863507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:19:01.876896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca9381-6e87-4ef6-b2a6-35852690de61 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:19:01.919986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:19:01.920781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:19:01.921071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:19:01.921350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:19:01.922022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:19:01.923473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:19:01.935951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:19:01.937111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application with Lock( Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: ERROR keystone.server.flask.application Jul 20 15:19:01.938267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 654/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jul 20 15:19:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:19:01.944224 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b9970-f5c8-4916-affd-21ab8e425dfd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:19:02.021492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:19:02.045665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b9970-f5c8-4916-affd-21ab8e425dfd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:19:02.078726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ac7ec-e08b-4cd9-ad2d-e2041416dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:19:02.079415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ac7ec-e08b-4cd9-ad2d-e2041416dab9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:19:02.079688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ac7ec-e08b-4cd9-ad2d-e2041416dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:19:02.079955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ac7ec-e08b-4cd9-ad2d-e2041416dab9 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:19:02.080654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ac7ec-e08b-4cd9-ad2d-e2041416dab9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:19:02.080959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ac7ec-e08b-4cd9-ad2d-e2041416dab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:19:02.082324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ac7ec-e08b-4cd9-ad2d-e2041416dab9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:19:02.087779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 651/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Jul 20 15:19:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:19:02.093923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:19:02.202386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41a5dc-093d-402e-a7f6-f3cc3c2482f1 None admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:19:02.239638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ed839-ab90-4531-9e76-c56663b126af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:19:02.240425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed839-ab90-4531-9e76-c56663b126af None admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:19:02.240704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed839-ab90-4531-9e76-c56663b126af None admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:19:02.240975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ed839-ab90-4531-9e76-c56663b126af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:19:02.241715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ed839-ab90-4531-9e76-c56663b126af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:19:02.243161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ed839-ab90-4531-9e76-c56663b126af None admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:19:02.264559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 655/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jul 20 15:19:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:19:12.084491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=30 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:19:12.259975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:05.356667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb8e63-0832-49bb-9ead-2728a161abd9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:05.357233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb8e63-0832-49bb-9ead-2728a161abd9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:05.357233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb8e63-0832-49bb-9ead-2728a161abd9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:05.358590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 652/1307] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:05.363902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9797-5235-4990-a065-293547a8d2a6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:05.364333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9797-5235-4990-a065-293547a8d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:05.364460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9797-5235-4990-a065-293547a8d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:05.454364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-305b9797-5235-4990-a065-293547a8d2a6 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:05.456653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-305b9797-5235-4990-a065-293547a8d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:05.669175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 656/1308] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:05.716194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c30f-dee7-45d0-b4de-5284958f9791 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:05.716480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c30f-dee7-45d0-b4de-5284958f9791 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:05.716978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c30f-dee7-45d0-b4de-5284958f9791 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:05.718502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 653/1309] 10.222.0.47 () {54 vars in 965 bytes} [Wed Jul 20 15:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:05.724413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ac03-2cd7-4177-ba80-43941310122d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:05.724787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ac03-2cd7-4177-ba80-43941310122d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:05.725133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ac03-2cd7-4177-ba80-43941310122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:05.807827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d491ac03-2cd7-4177-ba80-43941310122d None None] MFA Rules not processed for user `3894e1d2983e4040a4b0ae92ce794f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:05.808949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d491ac03-2cd7-4177-ba80-43941310122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:05.832663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:05.904100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 657/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Jul 20 15:20:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:20:05.912536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c30f-dee7-45d0-b4de-5284958f9791 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:05.915344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bf18c30f-dee7-45d0-b4de-5284958f9791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:06.045046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c30f-dee7-45d0-b4de-5284958f9791 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:06.128010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa63a3-2504-48c5-8d71-c2af4247be3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:06.129151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa63a3-2504-48c5-8d71-c2af4247be3a service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:06.129660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa63a3-2504-48c5-8d71-c2af4247be3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:06.130213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa63a3-2504-48c5-8d71-c2af4247be3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:06.132160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-60aa63a3-2504-48c5-8d71-c2af4247be3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:06.193866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:06.255324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa63a3-2504-48c5-8d71-c2af4247be3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:06.257257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa63a3-2504-48c5-8d71-c2af4247be3a service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:06.278830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 654/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:08.676144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e791-f4bb-482d-966b-fc9a7ec825ed None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:08.676727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e791-f4bb-482d-966b-fc9a7ec825ed None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:08.676727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e791-f4bb-482d-966b-fc9a7ec825ed None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:08.678179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 658/1312] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:08.684053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af3ee-8492-403b-bc9b-9ba8ebddbc52 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:08.684538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af3ee-8492-403b-bc9b-9ba8ebddbc52 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:08.684629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4af3ee-8492-403b-bc9b-9ba8ebddbc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:08.768510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6e4af3ee-8492-403b-bc9b-9ba8ebddbc52 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:08.769731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6e4af3ee-8492-403b-bc9b-9ba8ebddbc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:08.867798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 655/1313] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:08.907128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e791-f4bb-482d-966b-fc9a7ec825ed None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:08.908781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f7b6e791-f4bb-482d-966b-fc9a7ec825ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:09.022776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e791-f4bb-482d-966b-fc9a7ec825ed None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:09.098232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:09.101444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2198425-80c4-48a1-805d-ba6c1e181067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:09.102253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2198425-80c4-48a1-805d-ba6c1e181067 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:09.102796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2198425-80c4-48a1-805d-ba6c1e181067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:09.103214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2198425-80c4-48a1-805d-ba6c1e181067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:09.105492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f2198425-80c4-48a1-805d-ba6c1e181067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:09.236207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2198425-80c4-48a1-805d-ba6c1e181067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:09.237598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2198425-80c4-48a1-805d-ba6c1e181067 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:09.258779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 659/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:11.649116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457255a-f731-4505-bf40-aabfb0d1d51b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:11.649701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457255a-f731-4505-bf40-aabfb0d1d51b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:11.649701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457255a-f731-4505-bf40-aabfb0d1d51b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:11.651084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 656/1315] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:11.657514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4ca69-605f-49e8-8ac4-2fea7f962a3b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:11.658283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4ca69-605f-49e8-8ac4-2fea7f962a3b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:11.658475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4ca69-605f-49e8-8ac4-2fea7f962a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:11.746713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e0b4ca69-605f-49e8-8ac4-2fea7f962a3b None None] MFA Rules not processed for user `2628faec3f214ca38f3d8be5f4a57eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:11.748020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e0b4ca69-605f-49e8-8ac4-2fea7f962a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:11.807550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:11.876020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 660/1316] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:11.932051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051586b8-c790-461c-b389-fb84232cc86d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:11.932398 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051586b8-c790-461c-b389-fb84232cc86d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:11.932777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051586b8-c790-461c-b389-fb84232cc86d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:11.934960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 657/1317] 10.222.0.47 () {54 vars in 965 bytes} [Wed Jul 20 15:20:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:11.941562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a946b3b-f6e3-45e6-946f-a11847212f51 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:11.941865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a946b3b-f6e3-45e6-946f-a11847212f51 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:11.942140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a946b3b-f6e3-45e6-946f-a11847212f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:12.041463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7a946b3b-f6e3-45e6-946f-a11847212f51 None None] MFA Rules not processed for user `3894e1d2983e4040a4b0ae92ce794f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:12.042577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7a946b3b-f6e3-45e6-946f-a11847212f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:12.132326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 661/1318] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Jul 20 15:20:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:12.143711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051586b8-c790-461c-b389-fb84232cc86d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:12.146246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-051586b8-c790-461c-b389-fb84232cc86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:12.162356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:12.275181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051586b8-c790-461c-b389-fb84232cc86d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:12.355174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2515f-e87c-45ff-86da-085a68231159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:12.355751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2515f-e87c-45ff-86da-085a68231159 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:12.356028 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2515f-e87c-45ff-86da-085a68231159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:12.356300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2515f-e87c-45ff-86da-085a68231159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:12.357960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2fb2515f-e87c-45ff-86da-085a68231159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:12.427547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:12.477265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2515f-e87c-45ff-86da-085a68231159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:12.478779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2515f-e87c-45ff-86da-085a68231159 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:12.499924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 658/1319] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:15.438175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9640d3-8bcb-492c-a2d5-5ad410a2e2aa None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:15.439041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9640d3-8bcb-492c-a2d5-5ad410a2e2aa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:15.439041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9640d3-8bcb-492c-a2d5-5ad410a2e2aa None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:15.441161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 662/1320] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:15.449472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc05ef-959d-4b69-a3a8-e75223adb09b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:15.449896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc05ef-959d-4b69-a3a8-e75223adb09b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:15.450066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc05ef-959d-4b69-a3a8-e75223adb09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:15.525151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c4cc05ef-959d-4b69-a3a8-e75223adb09b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:15.526347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c4cc05ef-959d-4b69-a3a8-e75223adb09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:15.630608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 659/1321] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:15.673509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9640d3-8bcb-492c-a2d5-5ad410a2e2aa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:15.675053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ab9640d3-8bcb-492c-a2d5-5ad410a2e2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:15.725251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:15.785388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9640d3-8bcb-492c-a2d5-5ad410a2e2aa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:15.866460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782197a-ef94-4f12-8375-0f24556937db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:15.867144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782197a-ef94-4f12-8375-0f24556937db service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:15.867445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782197a-ef94-4f12-8375-0f24556937db service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:15.867789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782197a-ef94-4f12-8375-0f24556937db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:15.869448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a782197a-ef94-4f12-8375-0f24556937db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:15.974480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:15.988775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782197a-ef94-4f12-8375-0f24556937db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:15.990215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782197a-ef94-4f12-8375-0f24556937db service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:16.009921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 663/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:18.747106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fd679-dbcd-43d8-97c6-cf28036db835 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:18.747750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fd679-dbcd-43d8-97c6-cf28036db835 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:18.747750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fd679-dbcd-43d8-97c6-cf28036db835 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:18.749098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 660/1323] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:18.754578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a4ba-5d6b-47a3-9848-27a0a67d9c3f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:18.755053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a4ba-5d6b-47a3-9848-27a0a67d9c3f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:18.755165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a4ba-5d6b-47a3-9848-27a0a67d9c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:18.832965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d3e1a4ba-5d6b-47a3-9848-27a0a67d9c3f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:18.834212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d3e1a4ba-5d6b-47a3-9848-27a0a67d9c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:18.942013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 664/1324] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:18.979097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fd679-dbcd-43d8-97c6-cf28036db835 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:18.980665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-932fd679-dbcd-43d8-97c6-cf28036db835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:19.002745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:19.097052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fd679-dbcd-43d8-97c6-cf28036db835 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:19.180165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f0c7-385d-4219-858b-2ffb801814b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:19.180825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f0c7-385d-4219-858b-2ffb801814b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:19.181101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f0c7-385d-4219-858b-2ffb801814b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:19.181372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f0c7-385d-4219-858b-2ffb801814b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:19.183118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f341f0c7-385d-4219-858b-2ffb801814b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:19.259370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:19.299687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341f0c7-385d-4219-858b-2ffb801814b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:19.301052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341f0c7-385d-4219-858b-2ffb801814b6 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:19.319607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 661/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:21.396832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70881275-6baf-4c95-b725-748120a31386 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:21.397384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70881275-6baf-4c95-b725-748120a31386 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:21.397384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70881275-6baf-4c95-b725-748120a31386 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:21.398694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 665/1326] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:21.404429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52776a4-b3f1-4a25-b029-32a9ea02e13c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:21.404875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52776a4-b3f1-4a25-b029-32a9ea02e13c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:21.404981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52776a4-b3f1-4a25-b029-32a9ea02e13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:21.473587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e52776a4-b3f1-4a25-b029-32a9ea02e13c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:21.474831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e52776a4-b3f1-4a25-b029-32a9ea02e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:21.597653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 662/1327] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:21.634098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70881275-6baf-4c95-b725-748120a31386 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:21.635751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-70881275-6baf-4c95-b725-748120a31386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:21.698494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:21.744361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70881275-6baf-4c95-b725-748120a31386 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:21.824415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764590d-044c-4f55-b71d-01cfd5bfd433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:21.825075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764590d-044c-4f55-b71d-01cfd5bfd433 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:21.825357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764590d-044c-4f55-b71d-01cfd5bfd433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:21.825632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764590d-044c-4f55-b71d-01cfd5bfd433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:21.827338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e764590d-044c-4f55-b71d-01cfd5bfd433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:21.944796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:21.954922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764590d-044c-4f55-b71d-01cfd5bfd433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:21.956441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764590d-044c-4f55-b71d-01cfd5bfd433 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:21.975727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 666/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:24.077973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9072-c625-456c-b9a8-59cdf827d907 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:24.078531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9072-c625-456c-b9a8-59cdf827d907 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:24.078531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9072-c625-456c-b9a8-59cdf827d907 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:24.079805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 663/1329] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:24.086192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb718bd2-4e89-4c7e-9613-65c48cb6e070 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:24.086777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb718bd2-4e89-4c7e-9613-65c48cb6e070 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:24.087006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb718bd2-4e89-4c7e-9613-65c48cb6e070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:24.157136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fb718bd2-4e89-4c7e-9613-65c48cb6e070 None None] MFA Rules not processed for user `2628faec3f214ca38f3d8be5f4a57eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:24.158407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fb718bd2-4e89-4c7e-9613-65c48cb6e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:24.270915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 667/1330] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:24.308664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a9072-c625-456c-b9a8-59cdf827d907 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:24.310245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4c0a9072-c625-456c-b9a8-59cdf827d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:24.343406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:24.419325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a9072-c625-456c-b9a8-59cdf827d907 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:24.496092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe0729-d22a-4ee9-9fa0-66b790c2d965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:24.496757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe0729-d22a-4ee9-9fa0-66b790c2d965 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:24.497035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe0729-d22a-4ee9-9fa0-66b790c2d965 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:24.497305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe0729-d22a-4ee9-9fa0-66b790c2d965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:24.499019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-60fe0729-d22a-4ee9-9fa0-66b790c2d965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:24.597024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:24.633158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe0729-d22a-4ee9-9fa0-66b790c2d965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:24.634659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe0729-d22a-4ee9-9fa0-66b790c2d965 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:24.654065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 664/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:26.926843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db8813-543c-4538-a496-2d9f073da421 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:26.927484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db8813-543c-4538-a496-2d9f073da421 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:26.927484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db8813-543c-4538-a496-2d9f073da421 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:26.928802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 668/1332] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:26.935354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e180b-1c7e-4532-8608-79ea283de1db None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:26.936127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e180b-1c7e-4532-8608-79ea283de1db None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:26.936251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e180b-1c7e-4532-8608-79ea283de1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:27.010244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ca4e180b-1c7e-4532-8608-79ea283de1db None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:27.011491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ca4e180b-1c7e-4532-8608-79ea283de1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:27.111454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 665/1333] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:27.153839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db8813-543c-4538-a496-2d9f073da421 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:27.155410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-87db8813-543c-4538-a496-2d9f073da421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:27.227967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:27.266129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db8813-543c-4538-a496-2d9f073da421 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:27.351344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f767f8e-60fc-4aaa-bf18-187495b07595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:27.352421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f767f8e-60fc-4aaa-bf18-187495b07595 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:27.352696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f767f8e-60fc-4aaa-bf18-187495b07595 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:27.352970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f767f8e-60fc-4aaa-bf18-187495b07595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:27.354623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6f767f8e-60fc-4aaa-bf18-187495b07595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:27.479110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f767f8e-60fc-4aaa-bf18-187495b07595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:27.480549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f767f8e-60fc-4aaa-bf18-187495b07595 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:27.491073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:27.500642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 669/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:29.570763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b082c-6b7b-4435-b52a-4f63472c9d9f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:29.571764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b082c-6b7b-4435-b52a-4f63472c9d9f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:29.571764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b082c-6b7b-4435-b52a-4f63472c9d9f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:29.573989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 666/1335] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:29.582777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072bf8-c771-48d1-951f-64255523e7d3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:29.583246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072bf8-c771-48d1-951f-64255523e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:29.583398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072bf8-c771-48d1-951f-64255523e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:29.658143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bd072bf8-c771-48d1-951f-64255523e7d3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:29.659411 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bd072bf8-c771-48d1-951f-64255523e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:29.779956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 670/1336] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:29.822666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b082c-6b7b-4435-b52a-4f63472c9d9f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:29.824244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-674b082c-6b7b-4435-b52a-4f63472c9d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:29.865333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:29.935567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b082c-6b7b-4435-b52a-4f63472c9d9f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:30.030226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63965da4-61ae-4941-b527-0e9fa04e17bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:30.030802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63965da4-61ae-4941-b527-0e9fa04e17bd service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:30.031116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63965da4-61ae-4941-b527-0e9fa04e17bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:30.031390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63965da4-61ae-4941-b527-0e9fa04e17bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:30.033035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-63965da4-61ae-4941-b527-0e9fa04e17bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:30.115507 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:30.148890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63965da4-61ae-4941-b527-0e9fa04e17bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:30.150346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63965da4-61ae-4941-b527-0e9fa04e17bd service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:30.171477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 667/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:32.704419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464885f-5966-4fdb-8b4d-f47e21b4b5bd None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:32.705023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464885f-5966-4fdb-8b4d-f47e21b4b5bd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:32.705023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464885f-5966-4fdb-8b4d-f47e21b4b5bd None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:32.706389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 671/1338] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:32.713005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114848a3-a7a7-41e1-8899-642ad10e5ecf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:32.713512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114848a3-a7a7-41e1-8899-642ad10e5ecf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:32.713512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114848a3-a7a7-41e1-8899-642ad10e5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:32.789806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-114848a3-a7a7-41e1-8899-642ad10e5ecf None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:32.791061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-114848a3-a7a7-41e1-8899-642ad10e5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:32.907055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 668/1339] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:32.946449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464885f-5966-4fdb-8b4d-f47e21b4b5bd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:32.948867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8464885f-5966-4fdb-8b4d-f47e21b4b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:33.043701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:33.077571 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464885f-5966-4fdb-8b4d-f47e21b4b5bd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:33.155891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc669b6a-71a8-44d8-b11f-379c6ff11e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:33.156541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc669b6a-71a8-44d8-b11f-379c6ff11e87 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:33.156819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc669b6a-71a8-44d8-b11f-379c6ff11e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:33.157087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc669b6a-71a8-44d8-b11f-379c6ff11e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:33.158718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dc669b6a-71a8-44d8-b11f-379c6ff11e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:33.285347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc669b6a-71a8-44d8-b11f-379c6ff11e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:33.286812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc669b6a-71a8-44d8-b11f-379c6ff11e87 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:33.306317 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 672/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:37.446479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d049ef-cdcd-404d-b2ef-ae7d0cbd37b2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:37.447094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d049ef-cdcd-404d-b2ef-ae7d0cbd37b2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:37.447094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d049ef-cdcd-404d-b2ef-ae7d0cbd37b2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:37.448335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 669/1341] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:37.453659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8d0d-20e8-4435-8fb3-0d74256a309d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:37.454220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8d0d-20e8-4435-8fb3-0d74256a309d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:37.454220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8d0d-20e8-4435-8fb3-0d74256a309d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:37.458458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:37.521057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a16c8d0d-20e8-4435-8fb3-0d74256a309d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:37.522271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a16c8d0d-20e8-4435-8fb3-0d74256a309d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:37.622248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 673/1342] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:37.661181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d049ef-cdcd-404d-b2ef-ae7d0cbd37b2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:37.662733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-42d049ef-cdcd-404d-b2ef-ae7d0cbd37b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:37.713675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:37.773275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d049ef-cdcd-404d-b2ef-ae7d0cbd37b2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:37.847740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c68e8d-b940-4bc7-84f8-7e80f263e47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:37.848457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c68e8d-b940-4bc7-84f8-7e80f263e47b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:37.848676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c68e8d-b940-4bc7-84f8-7e80f263e47b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:37.848950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c68e8d-b940-4bc7-84f8-7e80f263e47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:37.850629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-10c68e8d-b940-4bc7-84f8-7e80f263e47b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:37.951038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:37.969691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c68e8d-b940-4bc7-84f8-7e80f263e47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:37.971129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c68e8d-b940-4bc7-84f8-7e80f263e47b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:37.990229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 670/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:40.627895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359086-0ad5-4c2b-8cca-7541d49b5d12 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:40.628507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359086-0ad5-4c2b-8cca-7541d49b5d12 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:40.628507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359086-0ad5-4c2b-8cca-7541d49b5d12 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:40.629854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 674/1344] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:40.635946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce190f-1f6d-4339-8b0d-9b58e090ac1a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:40.636493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce190f-1f6d-4339-8b0d-9b58e090ac1a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:40.636493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce190f-1f6d-4339-8b0d-9b58e090ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:40.714247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ecce190f-1f6d-4339-8b0d-9b58e090ac1a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:40.715562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ecce190f-1f6d-4339-8b0d-9b58e090ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:40.816228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 671/1345] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:40.854156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359086-0ad5-4c2b-8cca-7541d49b5d12 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:40.855800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9e359086-0ad5-4c2b-8cca-7541d49b5d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:40.962074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:40.980979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359086-0ad5-4c2b-8cca-7541d49b5d12 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:41.057935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6e3a2-b5f2-42ed-bd7b-6d7f653bff15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:41.058592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6e3a2-b5f2-42ed-bd7b-6d7f653bff15 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:41.058872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6e3a2-b5f2-42ed-bd7b-6d7f653bff15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:41.059176 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6e3a2-b5f2-42ed-bd7b-6d7f653bff15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:41.060807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-62f6e3a2-b5f2-42ed-bd7b-6d7f653bff15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:41.172967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6e3a2-b5f2-42ed-bd7b-6d7f653bff15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:41.174410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6e3a2-b5f2-42ed-bd7b-6d7f653bff15 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:41.193484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 675/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:45.167479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8bd9a-4b5b-47e2-b0ca-51f04da942ad None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:45.168034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8bd9a-4b5b-47e2-b0ca-51f04da942ad None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:45.168034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8bd9a-4b5b-47e2-b0ca-51f04da942ad None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:45.169689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 672/1347] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:45.175017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45a34-3232-42b6-a4ca-460225c073c1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:45.175525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45a34-3232-42b6-a4ca-460225c073c1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:45.175606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f45a34-3232-42b6-a4ca-460225c073c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:45.190330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:45.246542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-63f45a34-3232-42b6-a4ca-460225c073c1 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:45.247782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-63f45a34-3232-42b6-a4ca-460225c073c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:45.363763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 676/1348] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:45.403415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8bd9a-4b5b-47e2-b0ca-51f04da942ad None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:20:45.405054 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d1b8bd9a-4b5b-47e2-b0ca-51f04da942ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:45.466714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:45.516818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8bd9a-4b5b-47e2-b0ca-51f04da942ad None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:20:45.614231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707ac2d-fbfb-4ae9-bc2b-0c505547afba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:20:45.615011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707ac2d-fbfb-4ae9-bc2b-0c505547afba service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:45.615302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707ac2d-fbfb-4ae9-bc2b-0c505547afba service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:45.615580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707ac2d-fbfb-4ae9-bc2b-0c505547afba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:45.617292 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d707ac2d-fbfb-4ae9-bc2b-0c505547afba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:45.741447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:45.746858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707ac2d-fbfb-4ae9-bc2b-0c505547afba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:20:45.749148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707ac2d-fbfb-4ae9-bc2b-0c505547afba service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:20:45.773459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 673/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:20:50.628680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263009d-c550-40c6-9b5c-1cececfd84b8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:50.629166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263009d-c550-40c6-9b5c-1cececfd84b8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:50.629263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263009d-c550-40c6-9b5c-1cececfd84b8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:50.630788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 677/1350] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:50.636319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c27fc7-1e2b-459c-acdd-30cd4fabffe6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:50.636776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c27fc7-1e2b-459c-acdd-30cd4fabffe6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:50.636862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c27fc7-1e2b-459c-acdd-30cd4fabffe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:50.792862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b0c27fc7-1e2b-459c-acdd-30cd4fabffe6 None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:50.794328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b0c27fc7-1e2b-459c-acdd-30cd4fabffe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:50.930597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 674/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:20:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:54.962711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1645-a92a-47bd-a2bd-957ab8ba8666 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:54.963606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1645-a92a-47bd-a2bd-957ab8ba8666 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:54.963878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1645-a92a-47bd-a2bd-957ab8ba8666 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:54.965457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 678/1352] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:54.970919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439eec-a318-43c4-bf69-31767c472a1d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:54.971375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439eec-a318-43c4-bf69-31767c472a1d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:54.971784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21439eec-a318-43c4-bf69-31767c472a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:55.025947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:55.054477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-21439eec-a318-43c4-bf69-31767c472a1d None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:55.056030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-21439eec-a318-43c4-bf69-31767c472a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:55.171478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 675/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:20:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:20:55.361467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=59 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:56.560511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8429cd-f4c4-426e-b971-083275405ea0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:56.561206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8429cd-f4c4-426e-b971-083275405ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:56.561206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8429cd-f4c4-426e-b971-083275405ea0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:56.562434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 679/1354] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:20:56.567710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcabaf-2a9d-45cd-ab05-d4416046c5af None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:20:56.568117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcabaf-2a9d-45cd-ab05-d4416046c5af None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:20:56.568254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcabaf-2a9d-45cd-ab05-d4416046c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:20:56.648899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-72fcabaf-2a9d-45cd-ab05-d4416046c5af None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:20:56.650120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-72fcabaf-2a9d-45cd-ab05-d4416046c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:20:56.695589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:20:56.762577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 676/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:20:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:21:00.245458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ddf2-30a9-4e7d-984a-3f0115672299 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:00.246750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ddf2-30a9-4e7d-984a-3f0115672299 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:00.248154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ddf2-30a9-4e7d-984a-3f0115672299 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:00.252131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 680/1356] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:00.255491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af360-4264-409b-9304-8b33758b0dd0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:00.255942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af360-4264-409b-9304-8b33758b0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:00.256025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af360-4264-409b-9304-8b33758b0dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:00.339417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-785af360-4264-409b-9304-8b33758b0dd0 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:00.340880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-785af360-4264-409b-9304-8b33758b0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:00.449383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 677/1357] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:00.502650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceb7b7-83c6-4a9c-9de4-874238b05792 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:00.503465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceb7b7-83c6-4a9c-9de4-874238b05792 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:00.504004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ceb7b7-83c6-4a9c-9de4-874238b05792 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:00.506252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 681/1358] 10.222.0.47 () {54 vars in 962 bytes} [Wed Jul 20 15:21:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:00.513864 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a55c-599d-43db-b21c-ae540e7da916 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:00.514349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a55c-599d-43db-b21c-ae540e7da916 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:00.514719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a55c-599d-43db-b21c-ae540e7da916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:00.533548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:00.598268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5d50a55c-599d-43db-b21c-ae540e7da916 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:00.599872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5d50a55c-599d-43db-b21c-ae540e7da916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:00.753948 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 678/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Jul 20 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:00.761882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ceb7b7-83c6-4a9c-9de4-874238b05792 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:00.763559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-88ceb7b7-83c6-4a9c-9de4-874238b05792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:00.927217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ceb7b7-83c6-4a9c-9de4-874238b05792 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:01.012669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:01.055065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097cd1-8160-4d50-b442-0299fcda0b61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:01.055860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097cd1-8160-4d50-b442-0299fcda0b61 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:01.056253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097cd1-8160-4d50-b442-0299fcda0b61 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:01.056625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097cd1-8160-4d50-b442-0299fcda0b61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:01.058401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-13097cd1-8160-4d50-b442-0299fcda0b61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:01.159570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097cd1-8160-4d50-b442-0299fcda0b61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:01.161218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097cd1-8160-4d50-b442-0299fcda0b61 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:01.182489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 682/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:03.416556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493b37-4d3d-4a72-b2ec-665d977f50f8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:03.417133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493b37-4d3d-4a72-b2ec-665d977f50f8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:03.417133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493b37-4d3d-4a72-b2ec-665d977f50f8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:03.419117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 679/1361] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:03.423859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b84a3-3a36-44b3-b62a-191779597a19 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:03.424287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b84a3-3a36-44b3-b62a-191779597a19 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:03.424398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b84a3-3a36-44b3-b62a-191779597a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:03.495795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e48b84a3-3a36-44b3-b62a-191779597a19 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:03.497325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e48b84a3-3a36-44b3-b62a-191779597a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:03.542742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:03.615266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 683/1362] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:03.655895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493b37-4d3d-4a72-b2ec-665d977f50f8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:03.657627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd493b37-4d3d-4a72-b2ec-665d977f50f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:03.729720 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:03.817382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493b37-4d3d-4a72-b2ec-665d977f50f8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:03.978137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004399d8-7993-410e-ab3a-df956dc0997f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:03.978978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004399d8-7993-410e-ab3a-df956dc0997f service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:03.979363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004399d8-7993-410e-ab3a-df956dc0997f service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:03.979775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004399d8-7993-410e-ab3a-df956dc0997f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:03.981563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-004399d8-7993-410e-ab3a-df956dc0997f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:04.006494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:04.078116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004399d8-7993-410e-ab3a-df956dc0997f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:04.079951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004399d8-7993-410e-ab3a-df956dc0997f service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:04.099320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 680/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:06.481446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216e61-040b-40c2-ac8e-99ef300e83ac None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:06.482310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216e61-040b-40c2-ac8e-99ef300e83ac None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:06.482718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50216e61-040b-40c2-ac8e-99ef300e83ac None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:06.488438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 684/1364] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:21:06.490559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4cc76-f73c-4000-805a-f34ef3103962 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:06.491095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4cc76-f73c-4000-805a-f34ef3103962 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:06.491281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4cc76-f73c-4000-805a-f34ef3103962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:06.565855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-42f4cc76-f73c-4000-805a-f34ef3103962 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:06.567126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-42f4cc76-f73c-4000-805a-f34ef3103962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:06.672720 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:06.675116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 681/1365] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:06.722235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f53d-82a2-436b-9760-cfbb46709be0 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:06.722524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f53d-82a2-436b-9760-cfbb46709be0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:06.723191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f53d-82a2-436b-9760-cfbb46709be0 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:06.724767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 685/1366] 10.222.0.47 () {54 vars in 962 bytes} [Wed Jul 20 15:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:06.730634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3e376-5df6-4f45-91b4-bbde81eb81ca None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:06.730904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3e376-5df6-4f45-91b4-bbde81eb81ca None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:06.731341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3e376-5df6-4f45-91b4-bbde81eb81ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:06.812210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4ca3e376-5df6-4f45-91b4-bbde81eb81ca None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:06.813320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ca3e376-5df6-4f45-91b4-bbde81eb81ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:06.935254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 682/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Jul 20 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:06.951996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0f53d-82a2-436b-9760-cfbb46709be0 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:06.953696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-17c0f53d-82a2-436b-9760-cfbb46709be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:07.124529 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0f53d-82a2-436b-9760-cfbb46709be0 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:07.148502 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:07.248472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336979d0-04dc-45e4-91f3-3e422ede49e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:07.249129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336979d0-04dc-45e4-91f3-3e422ede49e6 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:07.249409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336979d0-04dc-45e4-91f3-3e422ede49e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:07.249682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336979d0-04dc-45e4-91f3-3e422ede49e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:07.251352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-336979d0-04dc-45e4-91f3-3e422ede49e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:07.346217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336979d0-04dc-45e4-91f3-3e422ede49e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:07.347903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336979d0-04dc-45e4-91f3-3e422ede49e6 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:07.367139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 686/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:08.344610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3fd7d-88f4-4a46-82fb-f941ca1be8c7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:08.345192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3fd7d-88f4-4a46-82fb-f941ca1be8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:08.345192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3fd7d-88f4-4a46-82fb-f941ca1be8c7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:08.346791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 683/1369] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:08.352284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9885a0-ecb6-41e6-8b54-9fde6cef0948 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:08.352760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9885a0-ecb6-41e6-8b54-9fde6cef0948 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:08.352842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9885a0-ecb6-41e6-8b54-9fde6cef0948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:08.385541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:08.421945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0e9885a0-ecb6-41e6-8b54-9fde6cef0948 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:08.423335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0e9885a0-ecb6-41e6-8b54-9fde6cef0948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:08.525196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 687/1370] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:08.871520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec65f4-38b2-4f56-81b7-4c4ef2245cf4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:08.871520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec65f4-38b2-4f56-81b7-4c4ef2245cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:08.871520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec65f4-38b2-4f56-81b7-4c4ef2245cf4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:08.871520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 684/1371] 10.222.0.47 () {54 vars in 964 bytes} [Wed Jul 20 15:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:08.875625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593758-63eb-4fd6-842b-8c88f142c592 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:08.875871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593758-63eb-4fd6-842b-8c88f142c592 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:08.876174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593758-63eb-4fd6-842b-8c88f142c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:08.961638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-76593758-63eb-4fd6-842b-8c88f142c592 None None] MFA Rules not processed for user `fc8b95ffc2324085bc736a6fa10f73f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:08.962869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-76593758-63eb-4fd6-842b-8c88f142c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:09.012138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:09.043699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 688/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Jul 20 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:09.051165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec65f4-38b2-4f56-81b7-4c4ef2245cf4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:09.052729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f6ec65f4-38b2-4f56-81b7-4c4ef2245cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:09.106214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:09.168986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec65f4-38b2-4f56-81b7-4c4ef2245cf4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:09.249781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3fd73-1daf-4510-be0f-2a0340052213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:09.250441 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fd73-1daf-4510-be0f-2a0340052213 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:09.250713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fd73-1daf-4510-be0f-2a0340052213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:09.250994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fd73-1daf-4510-be0f-2a0340052213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:09.252702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c0d3fd73-1daf-4510-be0f-2a0340052213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:09.353168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:09.367402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3fd73-1daf-4510-be0f-2a0340052213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:09.369509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3fd73-1daf-4510-be0f-2a0340052213 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:09.390112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 685/1373] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:09.471131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f80bb-4592-42da-9a90-c17daba4172c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:09.471131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f80bb-4592-42da-9a90-c17daba4172c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:09.471131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f80bb-4592-42da-9a90-c17daba4172c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:09.472760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 689/1374] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:09.479452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6980a0-f617-4adc-85fd-d75d68366f3d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:09.479452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6980a0-f617-4adc-85fd-d75d68366f3d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:09.479452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6980a0-f617-4adc-85fd-d75d68366f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:09.547556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dd6980a0-f617-4adc-85fd-d75d68366f3d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:09.548788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd6980a0-f617-4adc-85fd-d75d68366f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:09.659611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 686/1375] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:09.702207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f80bb-4592-42da-9a90-c17daba4172c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:09.703764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1a2f80bb-4592-42da-9a90-c17daba4172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:09.865791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f80bb-4592-42da-9a90-c17daba4172c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:09.917877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:09.983959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16157008-8554-48d1-b640-5eca451f474c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:09.984663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157008-8554-48d1-b640-5eca451f474c service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:09.984960 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157008-8554-48d1-b640-5eca451f474c service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:09.985241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157008-8554-48d1-b640-5eca451f474c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:09.986908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-16157008-8554-48d1-b640-5eca451f474c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:10.084746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16157008-8554-48d1-b640-5eca451f474c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:10.086673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16157008-8554-48d1-b640-5eca451f474c service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:10.106634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 690/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:12.183514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f50399-491b-49b8-b0ec-927e5fb8fecc None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:12.184013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f50399-491b-49b8-b0ec-927e5fb8fecc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:12.184123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f50399-491b-49b8-b0ec-927e5fb8fecc None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:12.185531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 687/1377] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:12.191173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b5fc9-1b73-43d4-a723-bf342bb63954 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:12.191739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b5fc9-1b73-43d4-a723-bf342bb63954 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:12.191739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b5fc9-1b73-43d4-a723-bf342bb63954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:12.260466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c38b5fc9-1b73-43d4-a723-bf342bb63954 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:12.261634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c38b5fc9-1b73-43d4-a723-bf342bb63954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:12.269408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:12.383923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 691/1378] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:12.431155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f50399-491b-49b8-b0ec-927e5fb8fecc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:12.432636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-48f50399-491b-49b8-b0ec-927e5fb8fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:12.508181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:12.596597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f50399-491b-49b8-b0ec-927e5fb8fecc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:12.724056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a677-a94e-4ecb-b39d-89e07446cecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:12.724716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a677-a94e-4ecb-b39d-89e07446cecb service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:12.724994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a677-a94e-4ecb-b39d-89e07446cecb service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:12.725247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a677-a94e-4ecb-b39d-89e07446cecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:12.727013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ae09a677-a94e-4ecb-b39d-89e07446cecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:12.745352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:12.827973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a677-a94e-4ecb-b39d-89e07446cecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:12.829681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09a677-a94e-4ecb-b39d-89e07446cecb service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:12.871805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 688/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:14.945626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c8e72-66b2-4e38-a758-2c14265481a4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:14.946534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c8e72-66b2-4e38-a758-2c14265481a4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:14.946534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c8e72-66b2-4e38-a758-2c14265481a4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:14.951242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 692/1380] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:14.958020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f405ac-d68f-4590-8d20-d97e45352296 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:14.958604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f405ac-d68f-4590-8d20-d97e45352296 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:14.958604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f405ac-d68f-4590-8d20-d97e45352296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:15.033314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f1f405ac-d68f-4590-8d20-d97e45352296 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:15.034555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f1f405ac-d68f-4590-8d20-d97e45352296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:15.132434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:15.139369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 689/1381] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:15.183463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c8e72-66b2-4e38-a758-2c14265481a4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:15.184949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c38c8e72-66b2-4e38-a758-2c14265481a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:15.333270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:15.345030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c8e72-66b2-4e38-a758-2c14265481a4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:15.468060 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb148-78da-4b88-a186-b9c4f06c4f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:15.468632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb148-78da-4b88-a186-b9c4f06c4f73 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:15.468916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb148-78da-4b88-a186-b9c4f06c4f73 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:15.469191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb148-78da-4b88-a186-b9c4f06c4f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:15.470819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5c0bb148-78da-4b88-a186-b9c4f06c4f73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:15.569631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bb148-78da-4b88-a186-b9c4f06c4f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:15.571388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bb148-78da-4b88-a186-b9c4f06c4f73 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:15.582892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:15.592980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 693/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:17.733552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3528f-fcfe-4ec1-9162-8ade787a9a42 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:17.734167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3528f-fcfe-4ec1-9162-8ade787a9a42 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:17.734330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3528f-fcfe-4ec1-9162-8ade787a9a42 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:17.736383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 690/1383] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:17.742187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7961c-4fdd-49b6-9cda-ffbe06e762db None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:17.742749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7961c-4fdd-49b6-9cda-ffbe06e762db None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:17.743062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7961c-4fdd-49b6-9cda-ffbe06e762db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:17.816208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0ed7961c-4fdd-49b6-9cda-ffbe06e762db None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:17.817467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ed7961c-4fdd-49b6-9cda-ffbe06e762db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:17.924407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 694/1384] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:17.969640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3528f-fcfe-4ec1-9162-8ade787a9a42 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:17.971648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-45e3528f-fcfe-4ec1-9162-8ade787a9a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:18.127794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3528f-fcfe-4ec1-9162-8ade787a9a42 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:18.211352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:18.266905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6531-75e5-4403-8cc2-9b5a53000758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:18.268081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6531-75e5-4403-8cc2-9b5a53000758 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:18.268608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6531-75e5-4403-8cc2-9b5a53000758 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:18.269103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6531-75e5-4403-8cc2-9b5a53000758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:18.272494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-38ab6531-75e5-4403-8cc2-9b5a53000758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:18.394491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6531-75e5-4403-8cc2-9b5a53000758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:18.396308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab6531-75e5-4403-8cc2-9b5a53000758 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:18.417167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 691/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:20.788756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b22a-1e41-4c5a-802c-c64f1af8aeea None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:20.789353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b22a-1e41-4c5a-802c-c64f1af8aeea None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:20.789559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b22a-1e41-4c5a-802c-c64f1af8aeea None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:20.791470 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 695/1386] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:20.798487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f61bda-18e5-4e9f-b68f-7e3d22d88deb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:20.799094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f61bda-18e5-4e9f-b68f-7e3d22d88deb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:20.799094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f61bda-18e5-4e9f-b68f-7e3d22d88deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:20.874321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-58f61bda-18e5-4e9f-b68f-7e3d22d88deb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:20.875613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-58f61bda-18e5-4e9f-b68f-7e3d22d88deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:20.908313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:20.983699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 692/1387] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:21.041729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b22a-1e41-4c5a-802c-c64f1af8aeea None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:21.043638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e240b22a-1e41-4c5a-802c-c64f1af8aeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:21.140447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:21.214791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b22a-1e41-4c5a-802c-c64f1af8aeea None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:21.347983 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66598a1f-4cdd-4293-9686-402c7d3470fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:21.348647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66598a1f-4cdd-4293-9686-402c7d3470fc service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:21.348928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66598a1f-4cdd-4293-9686-402c7d3470fc service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:21.349202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66598a1f-4cdd-4293-9686-402c7d3470fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:21.350852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-66598a1f-4cdd-4293-9686-402c7d3470fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:21.391919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:21.447713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66598a1f-4cdd-4293-9686-402c7d3470fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:21.449399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66598a1f-4cdd-4293-9686-402c7d3470fc service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:21.468501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 696/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:23.592765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9669-15d0-4994-81c3-22196ddc3a0a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:23.593366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9669-15d0-4994-81c3-22196ddc3a0a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:23.593366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9669-15d0-4994-81c3-22196ddc3a0a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:23.594688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 693/1389] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:23.600241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b295b-c198-4d6e-be69-787440880a2e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:23.600678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b295b-c198-4d6e-be69-787440880a2e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:23.600899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b295b-c198-4d6e-be69-787440880a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:23.666979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-966b295b-c198-4d6e-be69-787440880a2e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:23.668218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-966b295b-c198-4d6e-be69-787440880a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:23.765921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 697/1390] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:23.810075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9669-15d0-4994-81c3-22196ddc3a0a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:23.811726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a95c9669-15d0-4994-81c3-22196ddc3a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:23.975937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9669-15d0-4994-81c3-22196ddc3a0a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:23.992741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:24.092124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448d099-72ac-48db-ad3e-19aa5859843a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:24.092695 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d099-72ac-48db-ad3e-19aa5859843a service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:24.092980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d099-72ac-48db-ad3e-19aa5859843a service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:24.093254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448d099-72ac-48db-ad3e-19aa5859843a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:24.094913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0448d099-72ac-48db-ad3e-19aa5859843a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:24.183808 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448d099-72ac-48db-ad3e-19aa5859843a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:24.185428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448d099-72ac-48db-ad3e-19aa5859843a service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:24.203972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 694/1391] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:24.823662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01c68-0af0-4c4c-902a-8b4ab4a213c2 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:24.824323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01c68-0af0-4c4c-902a-8b4ab4a213c2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:24.824323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01c68-0af0-4c4c-902a-8b4ab4a213c2 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:24.825991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 698/1392] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:24.831288 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cebcde-6707-48ed-b96e-9a6718608754 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:24.831712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cebcde-6707-48ed-b96e-9a6718608754 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:24.831887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cebcde-6707-48ed-b96e-9a6718608754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:24.857189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:24.900461 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-11cebcde-6707-48ed-b96e-9a6718608754 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:24.901665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-11cebcde-6707-48ed-b96e-9a6718608754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:25.003320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 695/1393] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:25.059514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dbefb-d8eb-4dc9-8735-8a2ef6d766e6 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:25.059925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dbefb-d8eb-4dc9-8735-8a2ef6d766e6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:25.060271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dbefb-d8eb-4dc9-8735-8a2ef6d766e6 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:25.061730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 699/1394] 10.222.0.47 () {54 vars in 966 bytes} [Wed Jul 20 15:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:25.067008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0f036-5355-4936-9a7b-b78764e4c030 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:25.067303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0f036-5355-4936-9a7b-b78764e4c030 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:25.067582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0f036-5355-4936-9a7b-b78764e4c030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:25.145172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-12c0f036-5355-4936-9a7b-b78764e4c030 None None] MFA Rules not processed for user `0ac481e3d57a4b6fa07c120ca26f2e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:25.146492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-12c0f036-5355-4936-9a7b-b78764e4c030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:25.189656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:25.226491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 696/1395] 10.222.0.47 () {58 vars in 1063 bytes} [Wed Jul 20 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:25.234460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dbefb-d8eb-4dc9-8735-8a2ef6d766e6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:25.235985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2d0dbefb-d8eb-4dc9-8735-8a2ef6d766e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:25.250509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:25.346010 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dbefb-d8eb-4dc9-8735-8a2ef6d766e6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:25.427073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5eb9f-198a-41d2-bc6b-9876a6f6ad2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac481e3d57a4b6fa07c120ca26f2e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:25.427671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5eb9f-198a-41d2-bc6b-9876a6f6ad2d service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:25.427949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5eb9f-198a-41d2-bc6b-9876a6f6ad2d service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:25.428219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5eb9f-198a-41d2-bc6b-9876a6f6ad2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:25.429898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-54f5eb9f-198a-41d2-bc6b-9876a6f6ad2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:25.499621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:25.545790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5eb9f-198a-41d2-bc6b-9876a6f6ad2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:25.547294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5eb9f-198a-41d2-bc6b-9876a6f6ad2d service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:25.569018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 700/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:21:26.257285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0da4a-147f-4470-9f2b-7d7b90889c6f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:26.257913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0da4a-147f-4470-9f2b-7d7b90889c6f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:26.257913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0da4a-147f-4470-9f2b-7d7b90889c6f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:26.259399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 697/1397] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:26.264862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9abc-c51f-492b-9496-f548f0b42f16 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:26.265370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9abc-c51f-492b-9496-f548f0b42f16 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:26.265478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9abc-c51f-492b-9496-f548f0b42f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:26.297761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1608-cf88-4cfd-96a9-c52cc452a176 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:26.298058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1608-cf88-4cfd-96a9-c52cc452a176 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:26.298340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb1608-cf88-4cfd-96a9-c52cc452a176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:26.333608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7d1b9abc-c51f-492b-9496-f548f0b42f16 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:26.334815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d1b9abc-c51f-492b-9496-f548f0b42f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:26.364130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d1cb1608-cf88-4cfd-96a9-c52cc452a176 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:26.365412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d1cb1608-cf88-4cfd-96a9-c52cc452a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:26.440648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 701/1398] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:26.462994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 698/1399] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:26.485130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b9abc-c51f-492b-9496-f548f0b42f16 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:26.486469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d1b9abc-c51f-492b-9496-f548f0b42f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:26.508152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677556d-dcc5-47c6-803a-fa127a358194 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:26.508359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677556d-dcc5-47c6-803a-fa127a358194 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:26.508633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677556d-dcc5-47c6-803a-fa127a358194 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:26.510031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 699/1400] 10.222.0.47 () {54 vars in 943 bytes} [Wed Jul 20 15:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:21:26.516094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:26.516213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a14aa-de94-4f3d-9655-90007800a3f6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:26.516395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a14aa-de94-4f3d-9655-90007800a3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:26.516648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a14aa-de94-4f3d-9655-90007800a3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:26.584497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:26.596910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-659a14aa-de94-4f3d-9655-90007800a3f6 None None] MFA Rules not processed for user `8db8ce1a1d9143c491304d0b72ace736`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:26.598189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-659a14aa-de94-4f3d-9655-90007800a3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:26.605554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b9abc-c51f-492b-9496-f548f0b42f16 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:26.705040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 700/1401] 10.222.0.47 () {58 vars in 1040 bytes} [Wed Jul 20 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:21:26.715415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a14aa-de94-4f3d-9655-90007800a3f6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:26.721322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a749328-66d8-408d-80bc-0451c3fb4b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:26.722014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749328-66d8-408d-80bc-0451c3fb4b87 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:26.722289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749328-66d8-408d-80bc-0451c3fb4b87 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:26.722562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a749328-66d8-408d-80bc-0451c3fb4b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:26.724191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6a749328-66d8-408d-80bc-0451c3fb4b87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:26.725350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a14aa-de94-4f3d-9655-90007800a3f6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:26.741970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:26.815963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a749328-66d8-408d-80bc-0451c3fb4b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:26.817519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a749328-66d8-408d-80bc-0451c3fb4b87 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:26.833718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afcc30-2a35-4808-b22f-1fceae079e1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:26.834384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afcc30-2a35-4808-b22f-1fceae079e1c service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:26.834666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afcc30-2a35-4808-b22f-1fceae079e1c service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:26.834935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afcc30-2a35-4808-b22f-1fceae079e1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:26.836308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 702/1402] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:26.836695 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b0afcc30-2a35-4808-b22f-1fceae079e1c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:26.839368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:26.929061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afcc30-2a35-4808-b22f-1fceae079e1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:26.930704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afcc30-2a35-4808-b22f-1fceae079e1c service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:26.940675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 701/1403] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:21:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:21:28.915755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2646-4394-41e2-9e4b-12629c1fd004 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:28.916449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2646-4394-41e2-9e4b-12629c1fd004 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:28.916449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2646-4394-41e2-9e4b-12629c1fd004 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:28.917839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 703/1404] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:28.923044 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e4b0-52a5-49d6-a79e-f124eea94197 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:28.923479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e4b0-52a5-49d6-a79e-f124eea94197 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:28.923594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e4b0-52a5-49d6-a79e-f124eea94197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:28.997025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fad7e4b0-52a5-49d6-a79e-f124eea94197 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:28.997451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fad7e4b0-52a5-49d6-a79e-f124eea94197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:29.096279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:29.104912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 702/1405] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:29.150277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2646-4394-41e2-9e4b-12629c1fd004 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:29.151979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c34a2646-4394-41e2-9e4b-12629c1fd004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:29.304510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:29.307081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2646-4394-41e2-9e4b-12629c1fd004 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:29.436084 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea404ea-4219-4954-917c-ee6eebf0e2f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:29.436747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea404ea-4219-4954-917c-ee6eebf0e2f8 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:29.437030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea404ea-4219-4954-917c-ee6eebf0e2f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:29.437305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea404ea-4219-4954-917c-ee6eebf0e2f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:29.438993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cea404ea-4219-4954-917c-ee6eebf0e2f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:29.538548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea404ea-4219-4954-917c-ee6eebf0e2f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:29.540354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea404ea-4219-4954-917c-ee6eebf0e2f8 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:29.560792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 704/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:31.632855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9c46-f256-4152-be32-f191cef70753 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:31.633454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9c46-f256-4152-be32-f191cef70753 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:31.633454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9c46-f256-4152-be32-f191cef70753 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:31.634764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 703/1407] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:31.640183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a235-a589-45c9-8a3f-d7d9883d2f77 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:31.641022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a235-a589-45c9-8a3f-d7d9883d2f77 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:31.643867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a235-a589-45c9-8a3f-d7d9883d2f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:31.645315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:31.714993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-77a2a235-a589-45c9-8a3f-d7d9883d2f77 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:31.716779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-77a2a235-a589-45c9-8a3f-d7d9883d2f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:31.835466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 705/1408] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:31.868174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c9c46-f256-4152-be32-f191cef70753 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:31.869741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c8c9c46-f256-4152-be32-f191cef70753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:32.055445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c9c46-f256-4152-be32-f191cef70753 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:32.158544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:32.242506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7887e-b939-46e4-8780-606b93470fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:32.243304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7887e-b939-46e4-8780-606b93470fbb service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:32.243581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7887e-b939-46e4-8780-606b93470fbb service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:32.243862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7887e-b939-46e4-8780-606b93470fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:32.245719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8ec7887e-b939-46e4-8780-606b93470fbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:32.359946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7887e-b939-46e4-8780-606b93470fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:32.362221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7887e-b939-46e4-8780-606b93470fbb service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:32.385830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 704/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:41.822686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=64 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:42.383129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=64 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:49.090815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61e52-ea27-47b9-92d6-929fd33b4a49 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:49.091502 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61e52-ea27-47b9-92d6-929fd33b4a49 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:49.091502 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61e52-ea27-47b9-92d6-929fd33b4a49 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:49.092828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 706/1410] 10.222.0.47 () {54 vars in 918 bytes} [Wed Jul 20 15:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:49.098207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524768d-e22c-4872-ae07-fc576dca18cd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:49.098674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524768d-e22c-4872-ae07-fc576dca18cd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:49.098777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524768d-e22c-4872-ae07-fc576dca18cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:49.183731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8524768d-e22c-4872-ae07-fc576dca18cd None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:49.184983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8524768d-e22c-4872-ae07-fc576dca18cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:49.295464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 705/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Jul 20 15:21:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:21:49.310343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103f9e-c470-4db2-9980-7c60ac6c67b9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:49.310663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103f9e-c470-4db2-9980-7c60ac6c67b9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:49.310941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103f9e-c470-4db2-9980-7c60ac6c67b9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:49.312370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 707/1412] 10.222.0.47 () {54 vars in 918 bytes} [Wed Jul 20 15:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:49.317234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef985b-a21f-43f1-a5d7-613883bdd251 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:49.317522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef985b-a21f-43f1-a5d7-613883bdd251 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:49.317900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef985b-a21f-43f1-a5d7-613883bdd251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:49.390634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:49.394212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1aef985b-a21f-43f1-a5d7-613883bdd251 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:49.396254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1aef985b-a21f-43f1-a5d7-613883bdd251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:49.540956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 706/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Jul 20 15:21:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:52.050356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6bc38-b8ef-4fb8-9cc5-84b2e95955c9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:52.051316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6bc38-b8ef-4fb8-9cc5-84b2e95955c9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:52.051316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6bc38-b8ef-4fb8-9cc5-84b2e95955c9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:52.053509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:21:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:52.059263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129937a-b469-4922-90e8-51d57d195054 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:52.059711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129937a-b469-4922-90e8-51d57d195054 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:52.059819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129937a-b469-4922-90e8-51d57d195054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:52.126893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3129937a-b469-4922-90e8-51d57d195054 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:52.128115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3129937a-b469-4922-90e8-51d57d195054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:52.186920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:52.230647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:52.277324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6bc38-b8ef-4fb8-9cc5-84b2e95955c9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:52.278851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-92f6bc38-b8ef-4fb8-9cc5-84b2e95955c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:52.446264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6bc38-b8ef-4fb8-9cc5-84b2e95955c9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:52.525374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:52.567867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e97de-1de6-4514-88d7-45045ad0b10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:52.568565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e97de-1de6-4514-88d7-45045ad0b10a service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:52.568847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e97de-1de6-4514-88d7-45045ad0b10a service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:52.569118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e97de-1de6-4514-88d7-45045ad0b10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:52.570871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-145e97de-1de6-4514-88d7-45045ad0b10a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:52.667644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e97de-1de6-4514-88d7-45045ad0b10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:52.669463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e97de-1de6-4514-88d7-45045ad0b10a service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:52.697551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 709/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:53.606633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebd1b4-0ead-4247-801b-82837e6e2431 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:53.607187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebd1b4-0ead-4247-801b-82837e6e2431 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:53.607187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebd1b4-0ead-4247-801b-82837e6e2431 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:53.608621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:53.614013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aa8b6-e47c-407c-aa9c-f595552626fe None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:53.614446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aa8b6-e47c-407c-aa9c-f595552626fe None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:53.614555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aa8b6-e47c-407c-aa9c-f595552626fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:53.704908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b34aa8b6-e47c-407c-aa9c-f595552626fe None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:53.706774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b34aa8b6-e47c-407c-aa9c-f595552626fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:53.736120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:53.810051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:53.964794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebd1b4-0ead-4247-801b-82837e6e2431 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:53.967416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77ebd1b4-0ead-4247-801b-82837e6e2431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:54.125688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebd1b4-0ead-4247-801b-82837e6e2431 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:54.173153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:54.252511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a1d22-2064-42e1-a110-b1716eb8ceaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:54.253169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1d22-2064-42e1-a110-b1716eb8ceaa service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:54.253446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1d22-2064-42e1-a110-b1716eb8ceaa service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:54.253725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1d22-2064-42e1-a110-b1716eb8ceaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:54.255488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-020a1d22-2064-42e1-a110-b1716eb8ceaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:54.348635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a1d22-2064-42e1-a110-b1716eb8ceaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:54.350270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a1d22-2064-42e1-a110-b1716eb8ceaa service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:54.368754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 709/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:55.265743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50cc8f-683d-463b-aca2-dc2c498f7814 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:55.266294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50cc8f-683d-463b-aca2-dc2c498f7814 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:55.266294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50cc8f-683d-463b-aca2-dc2c498f7814 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:55.267659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:55.273857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10883-5ec1-45a0-8237-b68d0cfa5c6b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:55.274353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10883-5ec1-45a0-8237-b68d0cfa5c6b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:55.274353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10883-5ec1-45a0-8237-b68d0cfa5c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:55.342131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:55.364677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bfc10883-5ec1-45a0-8237-b68d0cfa5c6b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:55.365907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bfc10883-5ec1-45a0-8237-b68d0cfa5c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:55.466279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:55.617986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50cc8f-683d-463b-aca2-dc2c498f7814 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:55.620302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5d50cc8f-683d-463b-aca2-dc2c498f7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:55.786187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50cc8f-683d-463b-aca2-dc2c498f7814 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:55.799876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:55.913488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3a24d-d3a0-4bc4-a3eb-ae61509e809b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:55.914043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a24d-d3a0-4bc4-a3eb-ae61509e809b service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:55.914325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a24d-d3a0-4bc4-a3eb-ae61509e809b service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:55.914584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a24d-d3a0-4bc4-a3eb-ae61509e809b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:55.916262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b3b3a24d-d3a0-4bc4-a3eb-ae61509e809b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:56.012905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3a24d-d3a0-4bc4-a3eb-ae61509e809b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:56.014532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3a24d-d3a0-4bc4-a3eb-ae61509e809b service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:56.033405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 712/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:56.911975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c663d-b198-4cea-9dde-c518cd1bbd1d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:56.912930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c663d-b198-4cea-9dde-c518cd1bbd1d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:56.912930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c663d-b198-4cea-9dde-c518cd1bbd1d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:56.914486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:21:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:56.919914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdada9f-0445-4379-b6b2-cf7d71b00432 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:56.920355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdada9f-0445-4379-b6b2-cf7d71b00432 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:56.920525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdada9f-0445-4379-b6b2-cf7d71b00432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:56.940728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:57.000267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2fdada9f-0445-4379-b6b2-cf7d71b00432 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:57.001478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2fdada9f-0445-4379-b6b2-cf7d71b00432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:57.103953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:57.254051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c663d-b198-4cea-9dde-c518cd1bbd1d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:57.255616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-355c663d-b198-4cea-9dde-c518cd1bbd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:57.375078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:57.413111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c663d-b198-4cea-9dde-c518cd1bbd1d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:57.555399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d5566-5df7-4f7a-9baf-46ab507f4127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:57.555961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d5566-5df7-4f7a-9baf-46ab507f4127 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:57.556238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d5566-5df7-4f7a-9baf-46ab507f4127 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:57.556507 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d5566-5df7-4f7a-9baf-46ab507f4127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:57.558149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9f3d5566-5df7-4f7a-9baf-46ab507f4127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:57.638489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:57.653206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d5566-5df7-4f7a-9baf-46ab507f4127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:57.654817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d5566-5df7-4f7a-9baf-46ab507f4127 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:57.673445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 712/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:58.568700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27783f-c78c-4029-9efe-24779c708fc8 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:58.569307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27783f-c78c-4029-9efe-24779c708fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:58.569307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27783f-c78c-4029-9efe-24779c708fc8 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:58.570731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:58.576900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c603-a57c-4df2-8e34-d06cf3f5b716 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:58.577341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c603-a57c-4df2-8e34-d06cf3f5b716 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:58.577454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909c603-a57c-4df2-8e34-d06cf3f5b716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:58.664763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a909c603-a57c-4df2-8e34-d06cf3f5b716 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:58.665997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a909c603-a57c-4df2-8e34-d06cf3f5b716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:58.768793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:58.926349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27783f-c78c-4029-9efe-24779c708fc8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:58.929190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7a27783f-c78c-4029-9efe-24779c708fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:59.023958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:59.095777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27783f-c78c-4029-9efe-24779c708fc8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:59.216329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2dda-15e4-4ce2-99f2-b65e024b971c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:59.216988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2dda-15e4-4ce2-99f2-b65e024b971c service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:59.217265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2dda-15e4-4ce2-99f2-b65e024b971c service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:59.217539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2dda-15e4-4ce2-99f2-b65e024b971c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:59.219236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2a4d2dda-15e4-4ce2-99f2-b65e024b971c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:59.270810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:59.316266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2dda-15e4-4ce2-99f2-b65e024b971c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:59.318024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2dda-15e4-4ce2-99f2-b65e024b971c service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:59.336494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 715/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:00.156098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525ff8-3dc2-4a5d-8643-35abce2b3de4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:00.157004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525ff8-3dc2-4a5d-8643-35abce2b3de4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:00.157004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525ff8-3dc2-4a5d-8643-35abce2b3de4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:00.159140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:22:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:00.166041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8866f-900e-4c15-a614-e5351d44356c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:00.166477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8866f-900e-4c15-a614-e5351d44356c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:00.166587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8866f-900e-4c15-a614-e5351d44356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:00.246680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3ba8866f-900e-4c15-a614-e5351d44356c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:00.247875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ba8866f-900e-4c15-a614-e5351d44356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:00.346432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:00.496910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525ff8-3dc2-4a5d-8643-35abce2b3de4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:00.499307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c9525ff8-3dc2-4a5d-8643-35abce2b3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:00.557377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:00.662067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525ff8-3dc2-4a5d-8643-35abce2b3de4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:00.781390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e317fa-0979-4f51-9e7f-fc3806b359f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:00.782004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e317fa-0979-4f51-9e7f-fc3806b359f8 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:00.782286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e317fa-0979-4f51-9e7f-fc3806b359f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:00.782562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e317fa-0979-4f51-9e7f-fc3806b359f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:00.784281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a6e317fa-0979-4f51-9e7f-fc3806b359f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:00.791568 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:00.875551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e317fa-0979-4f51-9e7f-fc3806b359f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:00.877157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e317fa-0979-4f51-9e7f-fc3806b359f8 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:00.896484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 715/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:01.700953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dbd0d-b139-4841-96f8-cee1b33b47d7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:01.701527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dbd0d-b139-4841-96f8-cee1b33b47d7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:01.701527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dbd0d-b139-4841-96f8-cee1b33b47d7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:01.703642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:22:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:01.711335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e674c-5605-4c0f-a5f1-aba16e7ccd5e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:01.711817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e674c-5605-4c0f-a5f1-aba16e7ccd5e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:01.711953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e674c-5605-4c0f-a5f1-aba16e7ccd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:01.794412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6c3e674c-5605-4c0f-a5f1-aba16e7ccd5e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:01.795659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6c3e674c-5605-4c0f-a5f1-aba16e7ccd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:01.871040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:01.903789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:02.056147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dbd0d-b139-4841-96f8-cee1b33b47d7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:02.058508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d00dbd0d-b139-4841-96f8-cee1b33b47d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:02.081021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:02.227873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dbd0d-b139-4841-96f8-cee1b33b47d7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:02.325878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:02.353716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683d81f-4f20-4ce2-a2fb-6037cd201b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:02.354373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d81f-4f20-4ce2-a2fb-6037cd201b18 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:02.354650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d81f-4f20-4ce2-a2fb-6037cd201b18 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:02.354921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683d81f-4f20-4ce2-a2fb-6037cd201b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:02.356611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7683d81f-4f20-4ce2-a2fb-6037cd201b18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:02.458710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683d81f-4f20-4ce2-a2fb-6037cd201b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:02.460447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683d81f-4f20-4ce2-a2fb-6037cd201b18 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:02.479690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 718/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:03.288691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef5c8-61ee-45db-8795-a8003788a426 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:03.289541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef5c8-61ee-45db-8795-a8003788a426 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:03.289541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bef5c8-61ee-45db-8795-a8003788a426 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:03.291659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:22:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:03.300014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd588-7ac5-4489-9704-53a776e3d63a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:03.300456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd588-7ac5-4489-9704-53a776e3d63a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:03.300577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdd588-7ac5-4489-9704-53a776e3d63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:03.386788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-07cdd588-7ac5-4489-9704-53a776e3d63a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:03.388065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-07cdd588-7ac5-4489-9704-53a776e3d63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:03.439596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:03.507027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:03.666176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bef5c8-61ee-45db-8795-a8003788a426 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:03.667767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e9bef5c8-61ee-45db-8795-a8003788a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:03.838218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bef5c8-61ee-45db-8795-a8003788a426 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:03.910192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:03.984111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce045c1-1336-42b3-95be-7708933523d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:03.985048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce045c1-1336-42b3-95be-7708933523d4 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:03.985380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce045c1-1336-42b3-95be-7708933523d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:03.985751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce045c1-1336-42b3-95be-7708933523d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:03.988367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9ce045c1-1336-42b3-95be-7708933523d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:04.085132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce045c1-1336-42b3-95be-7708933523d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:04.087120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce045c1-1336-42b3-95be-7708933523d4 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:04.106866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 718/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:04.919362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5171a-e252-4049-9787-69fe03652207 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:04.920284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5171a-e252-4049-9787-69fe03652207 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:04.920284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5171a-e252-4049-9787-69fe03652207 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:04.922451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:22:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:04.928657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239582f-3871-49cc-9288-9fa96f7ba583 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:04.929433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239582f-3871-49cc-9288-9fa96f7ba583 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:04.929592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239582f-3871-49cc-9288-9fa96f7ba583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:05.008594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f239582f-3871-49cc-9288-9fa96f7ba583 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:05.009811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f239582f-3871-49cc-9288-9fa96f7ba583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:05.011842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:05.111194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:05.266750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5171a-e252-4049-9787-69fe03652207 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:05.269151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-acc5171a-e252-4049-9787-69fe03652207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:05.437924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5171a-e252-4049-9787-69fe03652207 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:05.464934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:05.558072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec71f44-1d68-4e07-a118-1a95e7128cc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:05.558732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71f44-1d68-4e07-a118-1a95e7128cc3 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:05.559045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71f44-1d68-4e07-a118-1a95e7128cc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:05.559328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71f44-1d68-4e07-a118-1a95e7128cc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:05.560976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ec71f44-1d68-4e07-a118-1a95e7128cc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:05.667879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec71f44-1d68-4e07-a118-1a95e7128cc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:05.669528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec71f44-1d68-4e07-a118-1a95e7128cc3 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:05.688347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 721/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:07.616048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ff1a-b4b0-483c-9548-566f1162728c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:07.616904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ff1a-b4b0-483c-9548-566f1162728c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:07.617081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ff1a-b4b0-483c-9548-566f1162728c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:07.619538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:07.629694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf59b6-ea22-4546-9ea7-beb944bab1e4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:07.630428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf59b6-ea22-4546-9ea7-beb944bab1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:07.630606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf59b6-ea22-4546-9ea7-beb944bab1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:07.678996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:07.715238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7baf59b6-ea22-4546-9ea7-beb944bab1e4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:07.716502 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7baf59b6-ea22-4546-9ea7-beb944bab1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:07.821809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:07.861577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1ff1a-b4b0-483c-9548-566f1162728c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:07.863197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d4d1ff1a-b4b0-483c-9548-566f1162728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:07.973607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1ff1a-b4b0-483c-9548-566f1162728c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:08.006943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:08.058548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9309-b47b-49dc-9f28-511e7f2b08df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:08.059234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9309-b47b-49dc-9f28-511e7f2b08df service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:08.059516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9309-b47b-49dc-9f28-511e7f2b08df service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:08.059774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9309-b47b-49dc-9f28-511e7f2b08df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:08.061648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed4a9309-b47b-49dc-9f28-511e7f2b08df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:08.181696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9309-b47b-49dc-9f28-511e7f2b08df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:08.183103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9309-b47b-49dc-9f28-511e7f2b08df service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:08.203860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 721/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:10.468136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fd30-42aa-4c6d-a8e4-c23d5eebe2c9 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:10.468730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fd30-42aa-4c6d-a8e4-c23d5eebe2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:10.468730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03fd30-42aa-4c6d-a8e4-c23d5eebe2c9 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:10.470947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:10.478878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce0ff7-2ce8-4020-8e78-12da47c9f98d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:10.479327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce0ff7-2ce8-4020-8e78-12da47c9f98d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:10.479501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce0ff7-2ce8-4020-8e78-12da47c9f98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:10.548164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-49ce0ff7-2ce8-4020-8e78-12da47c9f98d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:10.549386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49ce0ff7-2ce8-4020-8e78-12da47c9f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:10.562489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:10.654299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:10.694570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03fd30-42aa-4c6d-a8e4-c23d5eebe2c9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:10.696264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2f03fd30-42aa-4c6d-a8e4-c23d5eebe2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:10.817741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03fd30-42aa-4c6d-a8e4-c23d5eebe2c9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:10.830537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:10.896758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3460e-e08e-492d-bc3b-bd24685108cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:10.897416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3460e-e08e-492d-bc3b-bd24685108cf service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:10.897702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3460e-e08e-492d-bc3b-bd24685108cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:10.897985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3460e-e08e-492d-bc3b-bd24685108cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:10.899732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-abf3460e-e08e-492d-bc3b-bd24685108cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:11.022520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3460e-e08e-492d-bc3b-bd24685108cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:11.024065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3460e-e08e-492d-bc3b-bd24685108cf service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:11.043215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 724/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:13.447423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9806860-ad98-4bf1-96f1-73b12e66d020 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:13.448009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9806860-ad98-4bf1-96f1-73b12e66d020 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:13.448009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9806860-ad98-4bf1-96f1-73b12e66d020 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:13.449460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:13.456518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264958f9-3a22-4796-a7ac-8b4e13f593ba None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:13.457322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264958f9-3a22-4796-a7ac-8b4e13f593ba None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:13.457482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264958f9-3a22-4796-a7ac-8b4e13f593ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:13.513912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:13.537409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-264958f9-3a22-4796-a7ac-8b4e13f593ba None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:13.538656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-264958f9-3a22-4796-a7ac-8b4e13f593ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:13.650016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:13.692386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9806860-ad98-4bf1-96f1-73b12e66d020 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:13.695139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b9806860-ad98-4bf1-96f1-73b12e66d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:13.813707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9806860-ad98-4bf1-96f1-73b12e66d020 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:13.865397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:13.904499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ad65-0bc6-4574-b18a-666a4c9c33cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:13.905171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ad65-0bc6-4574-b18a-666a4c9c33cf service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:13.905460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ad65-0bc6-4574-b18a-666a4c9c33cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:13.905729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ad65-0bc6-4574-b18a-666a4c9c33cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:13.907421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ee30ad65-0bc6-4574-b18a-666a4c9c33cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:14.026166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30ad65-0bc6-4574-b18a-666a4c9c33cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:14.027652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30ad65-0bc6-4574-b18a-666a4c9c33cf service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:14.046169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 724/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:16.201508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da209d-c1bf-4898-b250-7d061eaf8f3f None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:16.202055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da209d-c1bf-4898-b250-7d061eaf8f3f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:16.202055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da209d-c1bf-4898-b250-7d061eaf8f3f None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:16.203436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:16.210532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18c73-ea10-4934-9b79-a948182b9256 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:16.211321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18c73-ea10-4934-9b79-a948182b9256 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:16.211602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18c73-ea10-4934-9b79-a948182b9256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:16.292275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-38a18c73-ea10-4934-9b79-a948182b9256 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:16.293505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-38a18c73-ea10-4934-9b79-a948182b9256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:16.314649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:16.394077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:16.437121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da209d-c1bf-4898-b250-7d061eaf8f3f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:16.438702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b2da209d-c1bf-4898-b250-7d061eaf8f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:16.550852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da209d-c1bf-4898-b250-7d061eaf8f3f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:16.571402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:16.631542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa441d-cb7c-46d1-ab2e-c245a3b7de8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:16.632198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa441d-cb7c-46d1-ab2e-c245a3b7de8e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:16.632593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa441d-cb7c-46d1-ab2e-c245a3b7de8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:16.632870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa441d-cb7c-46d1-ab2e-c245a3b7de8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:16.634537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-48aa441d-cb7c-46d1-ab2e-c245a3b7de8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:16.754171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa441d-cb7c-46d1-ab2e-c245a3b7de8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:16.755715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa441d-cb7c-46d1-ab2e-c245a3b7de8e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:16.774879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 727/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:18.879829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c230237-56fa-413e-9376-a27d87d5ed4a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:18.880715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c230237-56fa-413e-9376-a27d87d5ed4a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:18.880715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c230237-56fa-413e-9376-a27d87d5ed4a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:18.882869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:18.889303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9e95-6fd6-4ec4-9670-3bb672970f87 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:18.889773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9e95-6fd6-4ec4-9670-3bb672970f87 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:18.890053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9e95-6fd6-4ec4-9670-3bb672970f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:18.968170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:18.970959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6bec9e95-6fd6-4ec4-9670-3bb672970f87 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:18.972808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6bec9e95-6fd6-4ec4-9670-3bb672970f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:19.073654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:19.112826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c230237-56fa-413e-9376-a27d87d5ed4a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:19.114552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7c230237-56fa-413e-9376-a27d87d5ed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:19.353792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c230237-56fa-413e-9376-a27d87d5ed4a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:19.405937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:19.432760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51643a81-c6c1-4082-84d7-01266b7c6cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:19.433428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51643a81-c6c1-4082-84d7-01266b7c6cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:19.433712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51643a81-c6c1-4082-84d7-01266b7c6cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:19.433983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51643a81-c6c1-4082-84d7-01266b7c6cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:19.435718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-51643a81-c6c1-4082-84d7-01266b7c6cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:19.552935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51643a81-c6c1-4082-84d7-01266b7c6cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:19.554403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51643a81-c6c1-4082-84d7-01266b7c6cb6 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:19.572847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 727/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:21.666024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6e72a-9d3b-409d-9118-0fbda6b57ccb None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:21.666610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6e72a-9d3b-409d-9118-0fbda6b57ccb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:21.666610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6e72a-9d3b-409d-9118-0fbda6b57ccb None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:21.668817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:21.676931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ec8b-1fc2-4412-b5a1-d74145f3972a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:21.677409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ec8b-1fc2-4412-b5a1-d74145f3972a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:21.677520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ec8b-1fc2-4412-b5a1-d74145f3972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:21.744015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3c03ec8b-1fc2-4412-b5a1-d74145f3972a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:21.745236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3c03ec8b-1fc2-4412-b5a1-d74145f3972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:21.776385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:21.849040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:22:21.893005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6e72a-9d3b-409d-9118-0fbda6b57ccb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:21.894545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fba6e72a-9d3b-409d-9118-0fbda6b57ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:22.016052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6e72a-9d3b-409d-9118-0fbda6b57ccb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:22.046244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:22.095456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c3dd-869f-44b2-91c5-97d14af5c3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:22.096114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c3dd-869f-44b2-91c5-97d14af5c3af service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:22.096391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c3dd-869f-44b2-91c5-97d14af5c3af service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:22.096673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c3dd-869f-44b2-91c5-97d14af5c3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:22.098370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4374c3dd-869f-44b2-91c5-97d14af5c3af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:22.224316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374c3dd-869f-44b2-91c5-97d14af5c3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:22.226469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374c3dd-869f-44b2-91c5-97d14af5c3af service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:22.251654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 730/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:22:24.327712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca35fc9-8a9e-4bb3-9267-e7e3ce983683 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:24.328273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca35fc9-8a9e-4bb3-9267-e7e3ce983683 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:24.328273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca35fc9-8a9e-4bb3-9267-e7e3ce983683 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:24.329716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:24.336739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020057-f89c-412c-ac43-b0d9788e356f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:24.337496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020057-f89c-412c-ac43-b0d9788e356f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:24.337637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020057-f89c-412c-ac43-b0d9788e356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:24.416839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-28020057-f89c-412c-ac43-b0d9788e356f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:24.418068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-28020057-f89c-412c-ac43-b0d9788e356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:24.426744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:24.518200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:24.561951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca35fc9-8a9e-4bb3-9267-e7e3ce983683 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:24.564455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aca35fc9-8a9e-4bb3-9267-e7e3ce983683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:24.678654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca35fc9-8a9e-4bb3-9267-e7e3ce983683 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:24.751657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:24.770701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6670632-cda6-4892-861d-f58df2e7c54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:24.771407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670632-cda6-4892-861d-f58df2e7c54a service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:24.771685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670632-cda6-4892-861d-f58df2e7c54a service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:24.771949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670632-cda6-4892-861d-f58df2e7c54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:24.773671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c6670632-cda6-4892-861d-f58df2e7c54a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:24.890130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6670632-cda6-4892-861d-f58df2e7c54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:24.891655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6670632-cda6-4892-861d-f58df2e7c54a service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:24.910176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 730/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:26.994958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99dc60-a725-4ddf-83e0-ddbd5e2e7ad7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:26.995530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99dc60-a725-4ddf-83e0-ddbd5e2e7ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:26.995530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99dc60-a725-4ddf-83e0-ddbd5e2e7ad7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:26.997326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:27.002854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb53f-c458-44ca-9376-32dafe24d8cb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:27.003344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb53f-c458-44ca-9376-32dafe24d8cb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:27.003442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb53f-c458-44ca-9376-32dafe24d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:27.070813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-46deb53f-c458-44ca-9376-32dafe24d8cb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:27.072059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-46deb53f-c458-44ca-9376-32dafe24d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:27.119838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:27.181879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:27.222749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99dc60-a725-4ddf-83e0-ddbd5e2e7ad7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:27.224380 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9d99dc60-a725-4ddf-83e0-ddbd5e2e7ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:27.335171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99dc60-a725-4ddf-83e0-ddbd5e2e7ad7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:27.374291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:27.423739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cee16-18fc-4116-ba76-64a1c6165cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:27.424417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cee16-18fc-4116-ba76-64a1c6165cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:27.424809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cee16-18fc-4116-ba76-64a1c6165cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:27.425121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cee16-18fc-4116-ba76-64a1c6165cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:27.426891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c2cee16-18fc-4116-ba76-64a1c6165cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:27.552804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cee16-18fc-4116-ba76-64a1c6165cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:27.554377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cee16-18fc-4116-ba76-64a1c6165cd7 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:27.572605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 733/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:22:29.595288 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a514-d62c-41de-a9b6-ed2eb8bf399b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:29.595848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a514-d62c-41de-a9b6-ed2eb8bf399b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:29.595848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a514-d62c-41de-a9b6-ed2eb8bf399b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:29.597988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:29.604587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ea5e5-de3b-4d94-a6fe-20ef1a7714ea None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:29.605062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ea5e5-de3b-4d94-a6fe-20ef1a7714ea None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:29.605177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ea5e5-de3b-4d94-a6fe-20ef1a7714ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:29.675106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f72ea5e5-de3b-4d94-a6fe-20ef1a7714ea None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:29.676332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f72ea5e5-de3b-4d94-a6fe-20ef1a7714ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:29.694678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:29.777503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:29.820960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31a514-d62c-41de-a9b6-ed2eb8bf399b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:29.823019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b31a514-d62c-41de-a9b6-ed2eb8bf399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:29.949221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31a514-d62c-41de-a9b6-ed2eb8bf399b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:30.037319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:30.045652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de434bd4-dee0-4d09-9278-98542b1d7f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:30.046347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434bd4-dee0-4d09-9278-98542b1d7f0e service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:30.046627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434bd4-dee0-4d09-9278-98542b1d7f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:30.046901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434bd4-dee0-4d09-9278-98542b1d7f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:30.048636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-de434bd4-dee0-4d09-9278-98542b1d7f0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:30.168070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434bd4-dee0-4d09-9278-98542b1d7f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:30.170012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434bd4-dee0-4d09-9278-98542b1d7f0e service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:30.189397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 733/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:32.248755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b71a-51f2-431a-8f33-c4334caff190 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:32.249319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b71a-51f2-431a-8f33-c4334caff190 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:32.249319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b71a-51f2-431a-8f33-c4334caff190 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:32.250602 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:32.257289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bddaac-27dd-4a66-a737-8915258cf54a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:32.257747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bddaac-27dd-4a66-a737-8915258cf54a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:32.257852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bddaac-27dd-4a66-a737-8915258cf54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:32.323960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e7bddaac-27dd-4a66-a737-8915258cf54a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:32.325188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e7bddaac-27dd-4a66-a737-8915258cf54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:32.374473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:32.427323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:32.464370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54b71a-51f2-431a-8f33-c4334caff190 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:32.466762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eb54b71a-51f2-431a-8f33-c4334caff190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:32.587012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54b71a-51f2-431a-8f33-c4334caff190 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:32.635873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:32.663001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32fb9b-0cd5-4d32-99fb-b222770ed25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:32.663731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32fb9b-0cd5-4d32-99fb-b222770ed25e service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:32.664056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32fb9b-0cd5-4d32-99fb-b222770ed25e service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:32.664510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32fb9b-0cd5-4d32-99fb-b222770ed25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:32.666354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-da32fb9b-0cd5-4d32-99fb-b222770ed25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:32.783385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32fb9b-0cd5-4d32-99fb-b222770ed25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:32.784856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32fb9b-0cd5-4d32-99fb-b222770ed25e service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:32.804229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 736/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:42.425443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=22 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:42.801505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=66 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:52.943227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f7ce2-e233-498c-9373-90502b252673 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:52.943890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f7ce2-e233-498c-9373-90502b252673 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:52.943890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f7ce2-e233-498c-9373-90502b252673 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:52.945470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 735/1471] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:52.953088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cd153-ea0f-4de2-8538-2f92e729443a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:52.953900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cd153-ea0f-4de2-8538-2f92e729443a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:52.954426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cd153-ea0f-4de2-8538-2f92e729443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:53.035103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-555cd153-ea0f-4de2-8538-2f92e729443a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:53.036367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-555cd153-ea0f-4de2-8538-2f92e729443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:53.139252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 737/1472] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:53.223873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc5375-a9a6-42e7-bde5-82b5b8ffb7ab None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:53.224158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc5375-a9a6-42e7-bde5-82b5b8ffb7ab None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:53.224423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc5375-a9a6-42e7-bde5-82b5b8ffb7ab None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:53.225972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 736/1473] 10.222.0.47 () {54 vars in 966 bytes} [Wed Jul 20 15:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:53.231059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf5a1-3f43-4c45-a926-bea4bba789a2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:53.231352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf5a1-3f43-4c45-a926-bea4bba789a2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:53.231632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bf5a1-3f43-4c45-a926-bea4bba789a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:53.307369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-623bf5a1-3f43-4c45-a926-bea4bba789a2 None None] MFA Rules not processed for user `0ac481e3d57a4b6fa07c120ca26f2e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:53.308594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-623bf5a1-3f43-4c45-a926-bea4bba789a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:53.329738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:53.389567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 738/1474] 10.222.0.47 () {58 vars in 1063 bytes} [Wed Jul 20 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:53.397366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc5375-a9a6-42e7-bde5-82b5b8ffb7ab None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:53.398889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23bc5375-a9a6-42e7-bde5-82b5b8ffb7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:53.512303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc5375-a9a6-42e7-bde5-82b5b8ffb7ab None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:53.593557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed450d3-1b1d-4453-a9ea-dc211794157e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac481e3d57a4b6fa07c120ca26f2e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:53.594061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed450d3-1b1d-4453-a9ea-dc211794157e service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:53.594367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed450d3-1b1d-4453-a9ea-dc211794157e service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:53.594665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed450d3-1b1d-4453-a9ea-dc211794157e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:53.596355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2ed450d3-1b1d-4453-a9ea-dc211794157e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:53.655218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:53.712322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed450d3-1b1d-4453-a9ea-dc211794157e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:53.713798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed450d3-1b1d-4453-a9ea-dc211794157e service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:53.732784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 737/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:55.872500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11dda-7e4f-4211-bc7a-ab72e3e791f4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:55.873096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11dda-7e4f-4211-bc7a-ab72e3e791f4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:55.873096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11dda-7e4f-4211-bc7a-ab72e3e791f4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:55.874370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 739/1476] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:55.881041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151873-9c71-4713-9c8d-1689bba27d8c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:55.881828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151873-9c71-4713-9c8d-1689bba27d8c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:55.882009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151873-9c71-4713-9c8d-1689bba27d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:55.956196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fc151873-9c71-4713-9c8d-1689bba27d8c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:55.957601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fc151873-9c71-4713-9c8d-1689bba27d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:56.057935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 738/1477] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:56.085486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b11dda-7e4f-4211-bc7a-ab72e3e791f4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:56.087064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e9b11dda-7e4f-4211-bc7a-ab72e3e791f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:56.230191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b11dda-7e4f-4211-bc7a-ab72e3e791f4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:56.282193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:56.334666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84c5ca-1b58-401a-bcfb-5574b39b9b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:56.335629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84c5ca-1b58-401a-bcfb-5574b39b9b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:56.335961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84c5ca-1b58-401a-bcfb-5574b39b9b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:56.336224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84c5ca-1b58-401a-bcfb-5574b39b9b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:56.337288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84c5ca-1b58-401a-bcfb-5574b39b9b3c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:56.340671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-4c84c5ca-1b58-401a-bcfb-5574b39b9b3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:22:56.340671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 20 15:22:56.340671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: Jul 20 15:22:56.342402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84c5ca-1b58-401a-bcfb-5574b39b9b3c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:56.364605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 740/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jul 20 15:22:56 2022] GET /identity/v3/projects => generated 2553 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:22:58.426475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520be3b-bb6e-45b1-bb02-4c804bdd170b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:58.427073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520be3b-bb6e-45b1-bb02-4c804bdd170b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:58.427073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520be3b-bb6e-45b1-bb02-4c804bdd170b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:58.428400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 739/1479] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:58.434945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb3e3-f766-490f-a5fa-4478d301a216 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:58.435801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb3e3-f766-490f-a5fa-4478d301a216 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:58.435929 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb3e3-f766-490f-a5fa-4478d301a216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:58.506958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-713eb3e3-f766-490f-a5fa-4478d301a216 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:58.508208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-713eb3e3-f766-490f-a5fa-4478d301a216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:58.609143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 741/1480] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:58.655570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520be3b-bb6e-45b1-bb02-4c804bdd170b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:58.658003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c520be3b-bb6e-45b1-bb02-4c804bdd170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:58.670176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:58.817790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520be3b-bb6e-45b1-bb02-4c804bdd170b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:58.902426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:58.937807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddfac2-9159-40c4-af5b-c1cd309230d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:58.938470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfac2-9159-40c4-af5b-c1cd309230d4 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:58.938754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfac2-9159-40c4-af5b-c1cd309230d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:58.939032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfac2-9159-40c4-af5b-c1cd309230d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:58.940762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c4ddfac2-9159-40c4-af5b-c1cd309230d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:59.041114 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddfac2-9159-40c4-af5b-c1cd309230d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:59.042739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddfac2-9159-40c4-af5b-c1cd309230d4 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:59.069963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 740/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:01.281894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087730-2000-43d9-9e06-03ee44d1d88a None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:01.282452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087730-2000-43d9-9e06-03ee44d1d88a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:01.282452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087730-2000-43d9-9e06-03ee44d1d88a None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:01.284406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 742/1482] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:23:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:01.291160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58136-c690-4a7c-af47-f4c69ed4181a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:01.291577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58136-c690-4a7c-af47-f4c69ed4181a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:01.291735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58136-c690-4a7c-af47-f4c69ed4181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:01.361734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f7a58136-c690-4a7c-af47-f4c69ed4181a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:01.363249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f7a58136-c690-4a7c-af47-f4c69ed4181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:01.416869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:01.471925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 741/1483] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:01.509724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087730-2000-43d9-9e06-03ee44d1d88a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:01.511442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-46087730-2000-43d9-9e06-03ee44d1d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:01.540943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:01.623618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087730-2000-43d9-9e06-03ee44d1d88a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:01.715414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624533cd-206e-49e0-aef1-73d0c52053b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:01.716064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624533cd-206e-49e0-aef1-73d0c52053b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:01.716348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624533cd-206e-49e0-aef1-73d0c52053b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:01.716623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624533cd-206e-49e0-aef1-73d0c52053b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:01.718263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-624533cd-206e-49e0-aef1-73d0c52053b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:01.797715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:01.832051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624533cd-206e-49e0-aef1-73d0c52053b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:01.833520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624533cd-206e-49e0-aef1-73d0c52053b5 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:01.852981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 743/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:03.940835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454075-94a4-4f68-a77d-325755f84442 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:03.941626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454075-94a4-4f68-a77d-325755f84442 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:03.941626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7454075-94a4-4f68-a77d-325755f84442 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:03.943969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 742/1485] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:23:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:03.949585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0134-77ef-49fe-8096-048aa1209b82 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:03.950076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0134-77ef-49fe-8096-048aa1209b82 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:03.950672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0134-77ef-49fe-8096-048aa1209b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:04.018732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3bcc0134-77ef-49fe-8096-048aa1209b82 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:04.020111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3bcc0134-77ef-49fe-8096-048aa1209b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:04.131918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 744/1486] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:04.173536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7454075-94a4-4f68-a77d-325755f84442 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:04.176102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c7454075-94a4-4f68-a77d-325755f84442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:04.286372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7454075-94a4-4f68-a77d-325755f84442 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:04.371652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:04.373834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e8f53-f564-45e0-bbaa-21d7b69e9701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:04.374619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e8f53-f564-45e0-bbaa-21d7b69e9701 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:04.374914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e8f53-f564-45e0-bbaa-21d7b69e9701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:04.375209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e8f53-f564-45e0-bbaa-21d7b69e9701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:04.377957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e00e8f53-f564-45e0-bbaa-21d7b69e9701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:04.501539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e8f53-f564-45e0-bbaa-21d7b69e9701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:04.503015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e8f53-f564-45e0-bbaa-21d7b69e9701 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:04.524321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 743/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:06.734052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46af0c-f8c2-45fa-b270-af511cc2224c None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:06.734636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46af0c-f8c2-45fa-b270-af511cc2224c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:06.734636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46af0c-f8c2-45fa-b270-af511cc2224c None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:06.736036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 745/1488] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:06.742735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032b520-1be9-45af-b37a-4334d7226050 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:06.743446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032b520-1be9-45af-b37a-4334d7226050 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:06.743676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032b520-1be9-45af-b37a-4334d7226050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:06.820840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2032b520-1be9-45af-b37a-4334d7226050 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:06.822077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2032b520-1be9-45af-b37a-4334d7226050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:06.882071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:06.931555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 744/1489] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:06.979702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46af0c-f8c2-45fa-b270-af511cc2224c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:06.982220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cf46af0c-f8c2-45fa-b270-af511cc2224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:07.024477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:07.108627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46af0c-f8c2-45fa-b270-af511cc2224c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:07.199211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04aaf-01b3-4531-9dd9-d673c77f8893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:07.199868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04aaf-01b3-4531-9dd9-d673c77f8893 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:07.200147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04aaf-01b3-4531-9dd9-d673c77f8893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:07.200422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04aaf-01b3-4531-9dd9-d673c77f8893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:07.202078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-75b04aaf-01b3-4531-9dd9-d673c77f8893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:07.300253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:07.332548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b04aaf-01b3-4531-9dd9-d673c77f8893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:07.334049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b04aaf-01b3-4531-9dd9-d673c77f8893 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:07.353094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 746/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:09.589025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb4edc-9039-47df-a37c-6af1a962c4b8 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:09.589645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb4edc-9039-47df-a37c-6af1a962c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:09.589645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb4edc-9039-47df-a37c-6af1a962c4b8 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:09.590993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 745/1491] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jul 20 15:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:09.596613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2a30d-27e4-4c70-be53-6c5d0a11101d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:09.597117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2a30d-27e4-4c70-be53-6c5d0a11101d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:09.597117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2a30d-27e4-4c70-be53-6c5d0a11101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:09.673067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-15a2a30d-27e4-4c70-be53-6c5d0a11101d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:09.674734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15a2a30d-27e4-4c70-be53-6c5d0a11101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:09.791116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 747/1492] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jul 20 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:09.834905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb4edc-9039-47df-a37c-6af1a962c4b8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:09.837339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7edb4edc-9039-47df-a37c-6af1a962c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:09.955639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb4edc-9039-47df-a37c-6af1a962c4b8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:10.036989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578a7b2-8589-463d-bb8e-2bab545d8990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:10.037651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a7b2-8589-463d-bb8e-2bab545d8990 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:10.037932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a7b2-8589-463d-bb8e-2bab545d8990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:10.038203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578a7b2-8589-463d-bb8e-2bab545d8990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:10.039911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5578a7b2-8589-463d-bb8e-2bab545d8990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:10.049528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:10.156909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578a7b2-8589-463d-bb8e-2bab545d8990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:10.158355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578a7b2-8589-463d-bb8e-2bab545d8990 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:10.176802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 746/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:19.789243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=82 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:20.174050 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=50 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:40.037118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175bd8-0361-4e90-bddd-c822c6ef92e4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:40.037756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175bd8-0361-4e90-bddd-c822c6ef92e4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:40.037756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175bd8-0361-4e90-bddd-c822c6ef92e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:40.117619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-77175bd8-0361-4e90-bddd-c822c6ef92e4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:40.118843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-77175bd8-0361-4e90-bddd-c822c6ef92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:40.220635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 748/1494] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:40.229107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67474e2f-29a3-4d64-87dd-5d9e7de28559 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:40.229675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67474e2f-29a3-4d64-87dd-5d9e7de28559 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:40.229675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67474e2f-29a3-4d64-87dd-5d9e7de28559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:40.315106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-67474e2f-29a3-4d64-87dd-5d9e7de28559 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:40.316348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-67474e2f-29a3-4d64-87dd-5d9e7de28559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:40.430430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 747/1495] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:40.435507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77175bd8-0361-4e90-bddd-c822c6ef92e4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:40.436934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-77175bd8-0361-4e90-bddd-c822c6ef92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:40.450212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77175bd8-0361-4e90-bddd-c822c6ef92e4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:40.524640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:40.562609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:40.563338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:40.563607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:40.563884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:40.564613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:24:40.564922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:40.565969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:40.565969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 20 15:24:40.565969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: Jul 20 15:24:40.566889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:40.578940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 749/1496] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:24:40.588872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67474e2f-29a3-4d64-87dd-5d9e7de28559 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:40.606861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67474e2f-29a3-4d64-87dd-5d9e7de28559 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:40.679926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:40.723842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:40.723975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:40.724182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:40.724517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:40.725612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:40.727276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:40.727276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 20 15:24:40.727276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: Jul 20 15:24:40.728707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:40.796075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 748/1497] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:24:40 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:24:40.801137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:40.802949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:40.841522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c18a7-5304-43a1-a39b-68388dcf3c18 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:40.950855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:40.951601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:40.951858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:40.952161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:40.953055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:40.954052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:40.954052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 20 15:24:40.954052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: Jul 20 15:24:40.955373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:40.999243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 750/1498] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:24:40 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:24:41.003602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:41.005173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:41.073675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ce632-7f84-4b3c-bb16-6d76e7289c9a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:41.159515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:41.171843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:41.172550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:41.172838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:41.173104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:41.173829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:41.174853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:41.174853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 20 15:24:41.174853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: Jul 20 15:24:41.175777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:41.188085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 749/1499] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:24:41.194440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:41.196620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:41.212377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba186b8-cc65-4b28-b18a-081c152749d5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:41.239838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:41.315716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662547a-ceb1-4c0b-a9af-15c30f468464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:41.316390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662547a-ceb1-4c0b-a9af-15c30f468464 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:41.316669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662547a-ceb1-4c0b-a9af-15c30f468464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:41.316966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662547a-ceb1-4c0b-a9af-15c30f468464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:41.317693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662547a-ceb1-4c0b-a9af-15c30f468464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:41.318722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-b662547a-ceb1-4c0b-a9af-15c30f468464 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:41.318722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 20 15:24:41.318722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: Jul 20 15:24:41.319643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662547a-ceb1-4c0b-a9af-15c30f468464 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:41.332256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 751/1500] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:24:41.336742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:41.338303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:41.373938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d0890-566f-4bb1-bd14-ca260d058f42 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:41.474437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9c79a-b47f-47eb-a790-29cc117e6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:41.475362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c79a-b47f-47eb-a790-29cc117e6bda admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:41.475640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c79a-b47f-47eb-a790-29cc117e6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:41.475897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c79a-b47f-47eb-a790-29cc117e6bda admin admin] PATH_INFO: `/v3/projects/48b87e6010c447f4afdcb01baaa896a0/users/f9e1596cad8541328d91d03b98861cd0/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:41.498390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9c79a-b47f-47eb-a790-29cc117e6bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b87e6010c447f4afdcb01baaa896a0, user_id=f9e1596cad8541328d91d03b98861cd0, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:41.499472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-19a9c79a-b47f-47eb-a790-29cc117e6bda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:41.499472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 20 15:24:41.499472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: Jul 20 15:24:41.501415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9c79a-b47f-47eb-a790-29cc117e6bda admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:41.529012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 750/1501] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:24:41 2022] PUT /identity/v3/projects/48b87e6010c447f4afdcb01baaa896a0/users/f9e1596cad8541328d91d03b98861cd0/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:24:41.541897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c369b-61e0-46e8-ac9f-c55c255bc52a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:41.542189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c369b-61e0-46e8-ac9f-c55c255bc52a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:41.542464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c369b-61e0-46e8-ac9f-c55c255bc52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:41.611906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-288c369b-61e0-46e8-ac9f-c55c255bc52a None None] MFA Rules not processed for user `f9e1596cad8541328d91d03b98861cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:41.613060 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-288c369b-61e0-46e8-ac9f-c55c255bc52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:41.709019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 752/1502] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:24:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:41.722959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34f854-6141-43fa-87a1-26a815195c5f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:41.723281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34f854-6141-43fa-87a1-26a815195c5f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:41.723576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34f854-6141-43fa-87a1-26a815195c5f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:41.725012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 751/1503] 10.222.0.47 () {54 vars in 964 bytes} [Wed Jul 20 15:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:41.730130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79889857-a9cd-466f-8a15-024bf05f7ce2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:41.730423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79889857-a9cd-466f-8a15-024bf05f7ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:41.730697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79889857-a9cd-466f-8a15-024bf05f7ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:41.765236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:41.812845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-79889857-a9cd-466f-8a15-024bf05f7ce2 None None] MFA Rules not processed for user `fc8b95ffc2324085bc736a6fa10f73f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:41.814061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-79889857-a9cd-466f-8a15-024bf05f7ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:41.899297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 753/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Jul 20 15:24:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:41.907508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34f854-6141-43fa-87a1-26a815195c5f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:41.909032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3f34f854-6141-43fa-87a1-26a815195c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:41.964669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:42.019682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34f854-6141-43fa-87a1-26a815195c5f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:42.101935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:42.102638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:42.102916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:42.103244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:42.105017 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:42.221818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:42.223297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:42.226904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:42.243744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 752/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:42.298438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1b0ab-e19d-4daf-be4d-2d3829c56c15 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:42.298929 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1b0ab-e19d-4daf-be4d-2d3829c56c15 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:42.299078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1b0ab-e19d-4daf-be4d-2d3829c56c15 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:42.300363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 754/1506] 10.222.0.47 () {52 vars in 829 bytes} [Wed Jul 20 15:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:42.304168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:42.305402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:42.414088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2279390-b14d-40e9-b86d-3d87728b91b4 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:42.511181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:42.511983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:42.512268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:42.512531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] PATH_INFO: `/v3/users/f9e1596cad8541328d91d03b98861cd0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:42.525181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e1596cad8541328d91d03b98861cd0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:42.526308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:42.526308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 20 15:24:42.526308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: Jul 20 15:24:42.527552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:42.537649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:42.593610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e1596cad8541328d91d03b98861cd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:42.614380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e1596cad8541328d91d03b98861cd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:42.614833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e1596cad8541328d91d03b98861cd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:42.628135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e1596cad8541328d91d03b98861cd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:42.628666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e1596cad8541328d91d03b98861cd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:42.645249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 753/1507] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:24:42 2022] DELETE /identity/v3/users/f9e1596cad8541328d91d03b98861cd0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:24:42.649717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357bab-1f9f-4ede-abfd-3309c5f22ca3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:42.650008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357bab-1f9f-4ede-abfd-3309c5f22ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:42.650295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357bab-1f9f-4ede-abfd-3309c5f22ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:42.713537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9c357bab-1f9f-4ede-abfd-3309c5f22ca3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:42.714780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9c357bab-1f9f-4ede-abfd-3309c5f22ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:42.812312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:42.829382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 755/1508] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:42.840007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:42.841316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:42.955918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2a4f-80b8-4eb5-9407-805b83c950f7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:43.014806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:43.042778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a2da6-eedc-4f19-98f7-da06441b2c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:43.043477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2da6-eedc-4f19-98f7-da06441b2c1e service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:43.043829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2da6-eedc-4f19-98f7-da06441b2c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:43.044111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a2da6-eedc-4f19-98f7-da06441b2c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:43.045780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b18a2da6-eedc-4f19-98f7-da06441b2c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:43.162561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a2da6-eedc-4f19-98f7-da06441b2c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:43.163971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a2da6-eedc-4f19-98f7-da06441b2c1e service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:43.185005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 754/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:43.527158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357bab-1f9f-4ede-abfd-3309c5f22ca3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:43.528413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9c357bab-1f9f-4ede-abfd-3309c5f22ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:43.540034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357bab-1f9f-4ede-abfd-3309c5f22ca3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:43.637433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:43.638312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:43.638591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:43.638859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] PATH_INFO: `/v3/projects/48b87e6010c447f4afdcb01baaa896a0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:43.649732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b87e6010c447f4afdcb01baaa896a0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:43.650782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:43.650782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 20 15:24:43.650782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: Jul 20 15:24:43.652071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:43.715523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b87e6010c447f4afdcb01baaa896a0', 'request_id': 'req-06f7bb5e-bd31-4d76-9910-03e257059014'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:43.725960 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b87e6010c447f4afdcb01baaa896a0', 'request_id': 'req-06f7bb5e-bd31-4d76-9910-03e257059014'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:43.732124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b87e6010c447f4afdcb01baaa896a0', 'request_id': 'req-06f7bb5e-bd31-4d76-9910-03e257059014'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:43.763113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] The token cache is being invalidate because project 48b87e6010c447f4afdcb01baaa896a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:24:43.763322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:43.763708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-06f7bb5e-bd31-4d76-9910-03e257059014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:24:43.765215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 756/1510] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:24:43 2022] DELETE /identity/v3/projects/48b87e6010c447f4afdcb01baaa896a0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:24:53.182479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=62 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:53.760945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:30.069072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a78af-bfa1-4cf0-82f9-64f9e776101c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:30.069661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a78af-bfa1-4cf0-82f9-64f9e776101c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:30.069661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a78af-bfa1-4cf0-82f9-64f9e776101c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:30.070949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:30.077232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be8e4-d255-46cb-bbf1-2a67d1666c63 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:30.077948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be8e4-d255-46cb-bbf1-2a67d1666c63 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:30.078137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1be8e4-d255-46cb-bbf1-2a67d1666c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:30.176158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4f1be8e4-d255-46cb-bbf1-2a67d1666c63 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:30.177399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4f1be8e4-d255-46cb-bbf1-2a67d1666c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:30.449453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:30.609582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a78af-bfa1-4cf0-82f9-64f9e776101c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:30.612578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3c0a78af-bfa1-4cf0-82f9-64f9e776101c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:30.744023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a78af-bfa1-4cf0-82f9-64f9e776101c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:30.750197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0ca17-5ec0-480f-b02d-17846873d2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:30.750869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ca17-5ec0-480f-b02d-17846873d2ec service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:30.751192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ca17-5ec0-480f-b02d-17846873d2ec service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:30.751469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ca17-5ec0-480f-b02d-17846873d2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:30.760020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0ca17-5ec0-480f-b02d-17846873d2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:30.761736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0ca17-5ec0-480f-b02d-17846873d2ec service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:30.771403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 756/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:31.305650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b460-0424-447d-b680-a822fc2e59d7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:31.306255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b460-0424-447d-b680-a822fc2e59d7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:31.306255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b460-0424-447d-b680-a822fc2e59d7 None None] PATH_INFO: `/v3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:31.307616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 758/1514] 10.222.0.98 () {54 vars in 925 bytes} [Wed Jul 20 15:26:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:26:31.313827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ab98-819b-4320-bf04-30a028af83cd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:31.314275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ab98-819b-4320-bf04-30a028af83cd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:31.314391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ab98-819b-4320-bf04-30a028af83cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:31.377591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e6e4ab98-819b-4320-bf04-30a028af83cd None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:31.378871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6e4ab98-819b-4320-bf04-30a028af83cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:31.447438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:31.453902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 757/1515] 10.222.0.98 () {58 vars in 1015 bytes} [Wed Jul 20 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:31.623407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3679-b4fa-4952-9fb0-93a917bd49ca None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:31.623661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3679-b4fa-4952-9fb0-93a917bd49ca None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:31.623875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3679-b4fa-4952-9fb0-93a917bd49ca None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:31.625274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 759/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:31.630810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872549-a4cf-4480-a928-554975c0608a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:31.631125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872549-a4cf-4480-a928-554975c0608a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:31.631401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872549-a4cf-4480-a928-554975c0608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:31.650073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e9872549-a4cf-4480-a928-554975c0608a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:31.651318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e9872549-a4cf-4480-a928-554975c0608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:31.659709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 758/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:31.812046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a3679-b4fa-4952-9fb0-93a917bd49ca None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:31.828543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a3679-b4fa-4952-9fb0-93a917bd49ca None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:31.835384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c24e05-eb33-4526-a8f8-dd79bf5f6b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:31.836049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c24e05-eb33-4526-a8f8-dd79bf5f6b65 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:31.836330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c24e05-eb33-4526-a8f8-dd79bf5f6b65 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:31.836602 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c24e05-eb33-4526-a8f8-dd79bf5f6b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:31.845953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c24e05-eb33-4526-a8f8-dd79bf5f6b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:31.847646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c24e05-eb33-4526-a8f8-dd79bf5f6b65 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:31.857526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 760/1518] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:40.294026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3342-aa18-407c-b4bd-7e38175058e5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:40.295161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3342-aa18-407c-b4bd-7e38175058e5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:40.295161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3342-aa18-407c-b4bd-7e38175058e5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:40.296804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 759/1519] 10.222.0.47 () {54 vars in 961 bytes} [Wed Jul 20 15:26:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:26:40.302181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d062f-610d-44f7-a509-de6660531792 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:40.302684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d062f-610d-44f7-a509-de6660531792 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:40.302794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d062f-610d-44f7-a509-de6660531792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:40.321999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5e2d062f-610d-44f7-a509-de6660531792 None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:40.323371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5e2d062f-610d-44f7-a509-de6660531792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:40.333076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 761/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Jul 20 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:40.341011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc3342-aa18-407c-b4bd-7e38175058e5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:40.356466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc3342-aa18-407c-b4bd-7e38175058e5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:40.362163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8dde-613f-4340-9183-21beeb2bc0b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:40.362834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8dde-613f-4340-9183-21beeb2bc0b9 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:40.363290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8dde-613f-4340-9183-21beeb2bc0b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:40.363570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8dde-613f-4340-9183-21beeb2bc0b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:40.372971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa8dde-613f-4340-9183-21beeb2bc0b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:40.374862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa8dde-613f-4340-9183-21beeb2bc0b9 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:40.384737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 760/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:43.133842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d4a6-d016-4c6d-9501-4d28ff60ea54 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:43.134507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d4a6-d016-4c6d-9501-4d28ff60ea54 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:43.134507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d4a6-d016-4c6d-9501-4d28ff60ea54 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:43.135863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:43.142227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509555f-c855-476a-991c-f17fde52e943 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:43.142701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509555f-c855-476a-991c-f17fde52e943 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:43.142816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509555f-c855-476a-991c-f17fde52e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:43.168150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1509555f-c855-476a-991c-f17fde52e943 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:43.169419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1509555f-c855-476a-991c-f17fde52e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:43.181925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:43.338476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d4a6-d016-4c6d-9501-4d28ff60ea54 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:43.363699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d4a6-d016-4c6d-9501-4d28ff60ea54 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:43.370159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce7d00-5cf1-436c-8d2e-c33a5b27934e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:43.371172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7d00-5cf1-436c-8d2e-c33a5b27934e service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:43.371476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7d00-5cf1-436c-8d2e-c33a5b27934e service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:43.371745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7d00-5cf1-436c-8d2e-c33a5b27934e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:43.380605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7d00-5cf1-436c-8d2e-c33a5b27934e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:43.382279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7d00-5cf1-436c-8d2e-c33a5b27934e service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:43.391799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 763/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:44.240367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572721-08d7-4980-83ee-2de1f62347b5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:44.240959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572721-08d7-4980-83ee-2de1f62347b5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:44.240959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572721-08d7-4980-83ee-2de1f62347b5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:44.242264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:44.250353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cef08-6093-4a97-8fef-ac2fdea414cb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:44.250836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cef08-6093-4a97-8fef-ac2fdea414cb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:44.250946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cef08-6093-4a97-8fef-ac2fdea414cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:44.276163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bd0cef08-6093-4a97-8fef-ac2fdea414cb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:44.277389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bd0cef08-6093-4a97-8fef-ac2fdea414cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:44.286712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:44.441689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f572721-08d7-4980-83ee-2de1f62347b5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:44.464780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f572721-08d7-4980-83ee-2de1f62347b5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:44.471453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18a0ba-8ccf-49fb-a7cd-9964c3149297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:44.472102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18a0ba-8ccf-49fb-a7cd-9964c3149297 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:44.472446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18a0ba-8ccf-49fb-a7cd-9964c3149297 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:44.472720 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18a0ba-8ccf-49fb-a7cd-9964c3149297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:44.481822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18a0ba-8ccf-49fb-a7cd-9964c3149297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:44.483457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18a0ba-8ccf-49fb-a7cd-9964c3149297 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:44.495191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 763/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:48.670854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836894f9-1f61-45a8-8dc2-18502eb123c4 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:48.671538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836894f9-1f61-45a8-8dc2-18502eb123c4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:48.671538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836894f9-1f61-45a8-8dc2-18502eb123c4 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:48.673029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:48.680023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e602c4-b795-4079-b6d2-0dc3713b7654 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:48.680491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e602c4-b795-4079-b6d2-0dc3713b7654 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:48.680604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e602c4-b795-4079-b6d2-0dc3713b7654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:48.699915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-75e602c4-b795-4079-b6d2-0dc3713b7654 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:48.701173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-75e602c4-b795-4079-b6d2-0dc3713b7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:48.710403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:48.793398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836894f9-1f61-45a8-8dc2-18502eb123c4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:48.796382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-836894f9-1f61-45a8-8dc2-18502eb123c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:48.837922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:48.891389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836894f9-1f61-45a8-8dc2-18502eb123c4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:48.895947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f951-5832-42c2-bcb9-b5e60f87bf48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:48.896629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f951-5832-42c2-bcb9-b5e60f87bf48 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:48.896886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f951-5832-42c2-bcb9-b5e60f87bf48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:48.897177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f951-5832-42c2-bcb9-b5e60f87bf48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:48.907650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566f951-5832-42c2-bcb9-b5e60f87bf48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:48.909127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566f951-5832-42c2-bcb9-b5e60f87bf48 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:48.918866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 766/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:50.952923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491eb0-faf9-4e06-8cdd-c059550ad8aa None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:50.953787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491eb0-faf9-4e06-8cdd-c059550ad8aa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:50.953787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491eb0-faf9-4e06-8cdd-c059550ad8aa None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:50.956103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:26:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:50.961810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d96e4a-dcdb-49c8-adac-0fe43d3004c1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:50.962292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d96e4a-dcdb-49c8-adac-0fe43d3004c1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:50.962401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d96e4a-dcdb-49c8-adac-0fe43d3004c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:50.981453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d5d96e4a-dcdb-49c8-adac-0fe43d3004c1 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:50.982659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d5d96e4a-dcdb-49c8-adac-0fe43d3004c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:50.991704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:51.030028 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09491eb0-faf9-4e06-8cdd-c059550ad8aa None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:51.031964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-09491eb0-faf9-4e06-8cdd-c059550ad8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:51.045538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09491eb0-faf9-4e06-8cdd-c059550ad8aa None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:51.049601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e634f8-f0d5-4259-a194-aad5890c9b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:51.050278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e634f8-f0d5-4259-a194-aad5890c9b50 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:51.050561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e634f8-f0d5-4259-a194-aad5890c9b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:51.050837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e634f8-f0d5-4259-a194-aad5890c9b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:51.060475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e634f8-f0d5-4259-a194-aad5890c9b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:51.061964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e634f8-f0d5-4259-a194-aad5890c9b50 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:51.071455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 766/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:54.635528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4598f18-4200-4e4e-a483-0844160ec908 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:54.636413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4598f18-4200-4e4e-a483-0844160ec908 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:54.636413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4598f18-4200-4e4e-a483-0844160ec908 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:54.638560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:26:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:54.646381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451140-7ddd-4d0c-a5ab-6b0f8b3fc870 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:54.646867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451140-7ddd-4d0c-a5ab-6b0f8b3fc870 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:54.646992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451140-7ddd-4d0c-a5ab-6b0f8b3fc870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:54.666913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-53451140-7ddd-4d0c-a5ab-6b0f8b3fc870 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:54.668159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-53451140-7ddd-4d0c-a5ab-6b0f8b3fc870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:54.677430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:54.988999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4598f18-4200-4e4e-a483-0844160ec908 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:54.991457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b4598f18-4200-4e4e-a483-0844160ec908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:55.081847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4598f18-4200-4e4e-a483-0844160ec908 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:55.086015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792674d-bd11-4816-b43f-969a8a3a4a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:55.086668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792674d-bd11-4816-b43f-969a8a3a4a61 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:55.086957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792674d-bd11-4816-b43f-969a8a3a4a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:55.087265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792674d-bd11-4816-b43f-969a8a3a4a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:55.097743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792674d-bd11-4816-b43f-969a8a3a4a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:55.099282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792674d-bd11-4816-b43f-969a8a3a4a61 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:55.109636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 769/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:57.158826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ef936-1b0d-4f9b-8067-a89ad0f42e99 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:57.159491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ef936-1b0d-4f9b-8067-a89ad0f42e99 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:57.159491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ef936-1b0d-4f9b-8067-a89ad0f42e99 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:57.160771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:57.167036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1965226-ecf5-4c44-a97d-917d4934aa50 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:57.169361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1965226-ecf5-4c44-a97d-917d4934aa50 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:57.169361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1965226-ecf5-4c44-a97d-917d4934aa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:57.188428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b1965226-ecf5-4c44-a97d-917d4934aa50 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:57.189621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b1965226-ecf5-4c44-a97d-917d4934aa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:57.198661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:57.497481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ef936-1b0d-4f9b-8067-a89ad0f42e99 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:57.502929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-002ef936-1b0d-4f9b-8067-a89ad0f42e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:57.524811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ef936-1b0d-4f9b-8067-a89ad0f42e99 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:57.529931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11316f91-8322-46fa-863a-2ebcb93e4f54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:57.530594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11316f91-8322-46fa-863a-2ebcb93e4f54 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:57.530874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11316f91-8322-46fa-863a-2ebcb93e4f54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:57.531185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11316f91-8322-46fa-863a-2ebcb93e4f54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:57.545234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11316f91-8322-46fa-863a-2ebcb93e4f54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:57.547049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11316f91-8322-46fa-863a-2ebcb93e4f54 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:57.558838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 769/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:27:07.183588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=63 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:27:07.554650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=37 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:29.131374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ff967-5336-413c-b1b8-bbb26a8b5342 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.134837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ff967-5336-413c-b1b8-bbb26a8b5342 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.134837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ff967-5336-413c-b1b8-bbb26a8b5342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.156294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-db3ff967-5336-413c-b1b8-bbb26a8b5342 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.158254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-db3ff967-5336-413c-b1b8-bbb26a8b5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.159916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461df3-e12d-45bc-b91b-d09bd424f6e8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.160439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461df3-e12d-45bc-b91b-d09bd424f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.160535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461df3-e12d-45bc-b91b-d09bd424f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.181239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 771/1540] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.191777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69d90-aa75-4b36-b669-4364d05e61d2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.192228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69d90-aa75-4b36-b669-4364d05e61d2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.192885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d69d90-aa75-4b36-b669-4364d05e61d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.196249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-50461df3-e12d-45bc-b91b-d09bd424f6e8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.197492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-50461df3-e12d-45bc-b91b-d09bd424f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.214249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 770/1541] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:28:29.223029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bcd88-2598-40a1-bcf5-504e377f5f46 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.223369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bcd88-2598-40a1-bcf5-504e377f5f46 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.223590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bcd88-2598-40a1-bcf5-504e377f5f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.234270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-63d69d90-aa75-4b36-b669-4364d05e61d2 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.241444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-63d69d90-aa75-4b36-b669-4364d05e61d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.257362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c34bcd88-2598-40a1-bcf5-504e377f5f46 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.258669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c34bcd88-2598-40a1-bcf5-504e377f5f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.262426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 772/1542] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:28:29.268324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d69d90-aa75-4b36-b669-4364d05e61d2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.271722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 771/1543] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:28:29.275914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bcd88-2598-40a1-bcf5-504e377f5f46 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.282927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d69d90-aa75-4b36-b669-4364d05e61d2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.289806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.290501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.290784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.291101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.291841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:29.292149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.293318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bcd88-2598-40a1-bcf5-504e377f5f46 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.293982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.305785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.306895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.307408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.307894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.309193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:29.315780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.316172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 773/1544] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:29.317151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:28:29.317151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 20 15:28:29.317151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: Jul 20 15:28:29.318093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.324710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.339898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 772/1545] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:28:29.343590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81ef7-2019-4acc-9ae6-8795e6aee3ea admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.348686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.356988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c456d28-6a2f-42dd-a4d6-59e5b32e3c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.357685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456d28-6a2f-42dd-a4d6-59e5b32e3c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.358034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456d28-6a2f-42dd-a4d6-59e5b32e3c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.363004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456d28-6a2f-42dd-a4d6-59e5b32e3c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.363004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c456d28-6a2f-42dd-a4d6-59e5b32e3c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.363004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-6c456d28-6a2f-42dd-a4d6-59e5b32e3c3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:28:29.363004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 20 15:28:29.363004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: Jul 20 15:28:29.363004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c456d28-6a2f-42dd-a4d6-59e5b32e3c3d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.364680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f00f4-2d5b-43bb-a463-590cc1b7a2db admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.375822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69005e-ee19-43d1-a969-386511e21eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.376536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69005e-ee19-43d1-a969-386511e21eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.376811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69005e-ee19-43d1-a969-386511e21eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.377110 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69005e-ee19-43d1-a969-386511e21eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.377852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69005e-ee19-43d1-a969-386511e21eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.384406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69005e-ee19-43d1-a969-386511e21eaf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.429128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 774/1546] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:28:29.430604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef6037-fc18-4959-961c-809fd915ad15 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.430896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef6037-fc18-4959-961c-809fd915ad15 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.431201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef6037-fc18-4959-961c-809fd915ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.436612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 773/1547] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:29.441117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69005e-ee19-43d1-a969-386511e21eaf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.460938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0fef6037-fc18-4959-961c-809fd915ad15 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.462170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0fef6037-fc18-4959-961c-809fd915ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.531835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69005e-ee19-43d1-a969-386511e21eaf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.545741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.548424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.548715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.548995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.549729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.550783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:28:29.550783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 20 15:28:29.550783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: Jul 20 15:28:29.554371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.584872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 774/1548] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:29.586105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.592001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 775/1549] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.593925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06680b4f-1097-49f4-b8b3-285dc18d9241 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.594284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06680b4f-1097-49f4-b8b3-285dc18d9241 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.594654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06680b4f-1097-49f4-b8b3-285dc18d9241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.599853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7088ef4-4282-4aca-ba91-f919ae32ab0c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.606715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e318618-31a6-4575-a2a3-f48acfb4f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.607946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e318618-31a6-4575-a2a3-f48acfb4f65b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.608415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e318618-31a6-4575-a2a3-f48acfb4f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.608872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e318618-31a6-4575-a2a3-f48acfb4f65b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.609800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e318618-31a6-4575-a2a3-f48acfb4f65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.612059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e318618-31a6-4575-a2a3-f48acfb4f65b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.615757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-06680b4f-1097-49f4-b8b3-285dc18d9241 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.617024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-06680b4f-1097-49f4-b8b3-285dc18d9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.629167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 776/1550] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.630630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25581f-cb32-45f0-97dc-f495e157de96 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.630926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25581f-cb32-45f0-97dc-f495e157de96 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.631229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25581f-cb32-45f0-97dc-f495e157de96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.642653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 775/1551] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/users => generated 293 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:29.644940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556d7b1-acfe-47be-9c08-3d3e78bb1d8f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.645569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556d7b1-acfe-47be-9c08-3d3e78bb1d8f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.646077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556d7b1-acfe-47be-9c08-3d3e78bb1d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.653437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0d25581f-cb32-45f0-97dc-f495e157de96 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.654743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0d25581f-cb32-45f0-97dc-f495e157de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.663178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 777/1552] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.664397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17f5ad-e6ea-4a4d-9cce-7bf9e0e4dde4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.664712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17f5ad-e6ea-4a4d-9cce-7bf9e0e4dde4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.664990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17f5ad-e6ea-4a4d-9cce-7bf9e0e4dde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.665349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9556d7b1-acfe-47be-9c08-3d3e78bb1d8f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.666557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9556d7b1-acfe-47be-9c08-3d3e78bb1d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.676695 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 776/1553] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.677655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556d7b1-acfe-47be-9c08-3d3e78bb1d8f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.687262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556d7b1-acfe-47be-9c08-3d3e78bb1d8f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.688285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fa17f5ad-e6ea-4a4d-9cce-7bf9e0e4dde4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.689520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fa17f5ad-e6ea-4a4d-9cce-7bf9e0e4dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.692176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816da185-462a-444b-9872-455f5f9437e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.692853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816da185-462a-444b-9872-455f5f9437e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.693139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816da185-462a-444b-9872-455f5f9437e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.693443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816da185-462a-444b-9872-455f5f9437e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.694138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816da185-462a-444b-9872-455f5f9437e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.695805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816da185-462a-444b-9872-455f5f9437e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.697781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 778/1554] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.699030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea72c0-1e0e-4b62-8243-3623a6432904 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.699333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea72c0-1e0e-4b62-8243-3623a6432904 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.699621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea72c0-1e0e-4b62-8243-3623a6432904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.707205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 777/1555] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:29.708400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc6bd-581c-4aed-ba29-ecdc2115d041 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.708691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc6bd-581c-4aed-ba29-ecdc2115d041 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.708964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddc6bd-581c-4aed-ba29-ecdc2115d041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.721845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-92ea72c0-1e0e-4b62-8243-3623a6432904 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.723159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-92ea72c0-1e0e-4b62-8243-3623a6432904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.727394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f4ddc6bd-581c-4aed-ba29-ecdc2115d041 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.728574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f4ddc6bd-581c-4aed-ba29-ecdc2115d041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.736787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 779/1556] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.736787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b27a1-ae83-4876-b1d4-c71ca5367657 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.736787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b27a1-ae83-4876-b1d4-c71ca5367657 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.736787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b27a1-ae83-4876-b1d4-c71ca5367657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.738925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 778/1557] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.740590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddc6bd-581c-4aed-ba29-ecdc2115d041 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.754670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddc6bd-581c-4aed-ba29-ecdc2115d041 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.755039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2c0b27a1-ae83-4876-b1d4-c71ca5367657 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.756245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2c0b27a1-ae83-4876-b1d4-c71ca5367657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.759596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02738be9-e120-4043-8aed-a60d668b3015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.760268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02738be9-e120-4043-8aed-a60d668b3015 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.760547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02738be9-e120-4043-8aed-a60d668b3015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.760820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02738be9-e120-4043-8aed-a60d668b3015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.761568 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02738be9-e120-4043-8aed-a60d668b3015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.763207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02738be9-e120-4043-8aed-a60d668b3015 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.765073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 780/1558] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.766569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022972d4-b8a2-461e-b290-02b7fcd2fd5c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.766877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022972d4-b8a2-461e-b290-02b7fcd2fd5c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.767189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022972d4-b8a2-461e-b290-02b7fcd2fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.781036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 779/1559] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:29.782684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77441586-1353-4da3-b373-d6295db72512 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.782917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77441586-1353-4da3-b373-d6295db72512 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.783262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77441586-1353-4da3-b373-d6295db72512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.788504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-022972d4-b8a2-461e-b290-02b7fcd2fd5c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.789743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-022972d4-b8a2-461e-b290-02b7fcd2fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.798443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 781/1560] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.802251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4328-939f-41f4-85bd-a65bf577a664 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.802251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4328-939f-41f4-85bd-a65bf577a664 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.802251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d4328-939f-41f4-85bd-a65bf577a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.803016 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-77441586-1353-4da3-b373-d6295db72512 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.804242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-77441586-1353-4da3-b373-d6295db72512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.812738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 780/1561] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.813667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77441586-1353-4da3-b373-d6295db72512 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.820782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c00d4328-939f-41f4-85bd-a65bf577a664 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.822066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c00d4328-939f-41f4-85bd-a65bf577a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.824329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77441586-1353-4da3-b373-d6295db72512 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.830492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9481-6bb2-428a-9fd7-648fbc0f8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.830941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 782/1562] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.831202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9481-6bb2-428a-9fd7-648fbc0f8fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.831480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9481-6bb2-428a-9fd7-648fbc0f8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.831752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9481-6bb2-428a-9fd7-648fbc0f8fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.831850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d4328-939f-41f4-85bd-a65bf577a664 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.832476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9481-6bb2-428a-9fd7-648fbc0f8fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.834095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9481-6bb2-428a-9fd7-648fbc0f8fd2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.840943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d4328-939f-41f4-85bd-a65bf577a664 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.845813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d16406-0835-40a6-9b05-71d966b0ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.845981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 781/1563] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:29.847844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d16406-0835-40a6-9b05-71d966b0ff4c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.847992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9481-6bb2-428a-9fd7-648fbc0f8fd2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.848096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d16406-0835-40a6-9b05-71d966b0ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.848096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d16406-0835-40a6-9b05-71d966b0ff4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.848096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d16406-0835-40a6-9b05-71d966b0ff4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:29.848096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d16406-0835-40a6-9b05-71d966b0ff4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.849707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d16406-0835-40a6-9b05-71d966b0ff4c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.859347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9481-6bb2-428a-9fd7-648fbc0f8fd2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.862980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 783/1564] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:29.864656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0bce-aaba-42bc-b46f-8a9e0e2d1dff None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.864919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0bce-aaba-42bc-b46f-8a9e0e2d1dff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.865283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0bce-aaba-42bc-b46f-8a9e0e2d1dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.865685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.866430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.866880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.867206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.867949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:29.868232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.869919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.884640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 782/1565] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:29.885546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.894769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9d0a0bce-aaba-42bc-b46f-8a9e0e2d1dff None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:29.895718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfeb8-f1b3-429b-95c2-c9470af271fc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.896000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9d0a0bce-aaba-42bc-b46f-8a9e0e2d1dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:29.900409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94130f-e1d1-441a-98c6-7d3698748696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.901085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94130f-e1d1-441a-98c6-7d3698748696 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.901370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94130f-e1d1-441a-98c6-7d3698748696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.901644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94130f-e1d1-441a-98c6-7d3698748696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.902379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94130f-e1d1-441a-98c6-7d3698748696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.904025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94130f-e1d1-441a-98c6-7d3698748696 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.904475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 784/1566] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:29.905279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0bce-aaba-42bc-b46f-8a9e0e2d1dff None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.915367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 783/1567] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:29.916125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0bce-aaba-42bc-b46f-8a9e0e2d1dff None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.916250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94130f-e1d1-441a-98c6-7d3698748696 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.922262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.923015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.923372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.923638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.924346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:29.924654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.926292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.927079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94130f-e1d1-441a-98c6-7d3698748696 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.932826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.933499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.933785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.934095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.934782 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:29.935196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.936819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.939100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:29.949386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 785/1568] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:29.950225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.954532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 784/1569] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:29.955477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.962523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e786-c44e-4d4d-8911-7ce8cfcc494a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.966262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93befd2-d0af-40a4-a369-65e0625af945 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:29.967751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.968444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.968714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.968981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.969702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:29.970067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.971637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69987ed2-4238-4d7e-8189-fb73aeca8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:29.971770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.972830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69987ed2-4238-4d7e-8189-fb73aeca8083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:29.973111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69987ed2-4238-4d7e-8189-fb73aeca8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:29.973408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69987ed2-4238-4d7e-8189-fb73aeca8083 admin admin] PATH_INFO: `/v3/projects/e401f1926f5544c5ac7e5fc74a4cbfba/users/ca34c50cd12e42a28c3cfe7c434e4113/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:29.985567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 786/1570] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:29.986369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:29.989348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69987ed2-4238-4d7e-8189-fb73aeca8083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e401f1926f5544c5ac7e5fc74a4cbfba, user_id=ca34c50cd12e42a28c3cfe7c434e4113, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:29.992280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69987ed2-4238-4d7e-8189-fb73aeca8083 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:29.995859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8caed-fbc2-46e1-afb0-a73632266478 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.001839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8730f0e-67d1-4493-a4f0-a8a263f9b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.002182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8730f0e-67d1-4493-a4f0-a8a263f9b02b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.002463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8730f0e-67d1-4493-a4f0-a8a263f9b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.002734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8730f0e-67d1-4493-a4f0-a8a263f9b02b admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.003459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8730f0e-67d1-4493-a4f0-a8a263f9b02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.005459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8730f0e-67d1-4493-a4f0-a8a263f9b02b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.007872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 785/1571] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:29 2022] PUT /identity/v3/projects/e401f1926f5544c5ac7e5fc74a4cbfba/users/ca34c50cd12e42a28c3cfe7c434e4113/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:30.011879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69987ed2-4238-4d7e-8189-fb73aeca8083 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.014207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:30.038258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 787/1572] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:29 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.038258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8730f0e-67d1-4493-a4f0-a8a263f9b02b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.081544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69987ed2-4238-4d7e-8189-fb73aeca8083 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.109025 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8730f0e-67d1-4493-a4f0-a8a263f9b02b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.113940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.114608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.114863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.115172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.115892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:30.116188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.117783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.130679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 788/1573] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:30.131694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.142593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ed92e-9585-4eb9-99ce-ea1069b2a6cb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.145582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1b1fb-f62e-480f-816b-a18268dfcaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.146271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1b1fb-f62e-480f-816b-a18268dfcaff admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.146556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1b1fb-f62e-480f-816b-a18268dfcaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.146815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1b1fb-f62e-480f-816b-a18268dfcaff admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.147570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1b1fb-f62e-480f-816b-a18268dfcaff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.147747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.148482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.149414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.149514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1b1fb-f62e-480f-816b-a18268dfcaff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.149690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] PATH_INFO: `/v3/projects/0e14bbdad80e410d98afbdee360ea218/users/7e1520127f034619b03f909614251503/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.165676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e14bbdad80e410d98afbdee360ea218, user_id=7e1520127f034619b03f909614251503, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.166886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:28:30.166886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 20 15:28:30.166886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: Jul 20 15:28:30.168910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.182442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 786/1574] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.182442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1b1fb-f62e-480f-816b-a18268dfcaff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.185504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 789/1575] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:30 2022] PUT /identity/v3/projects/0e14bbdad80e410d98afbdee360ea218/users/7e1520127f034619b03f909614251503/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:30.186352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.251477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1b1fb-f62e-480f-816b-a18268dfcaff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.256199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:30.265359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f733cd5-6d82-4d40-ac07-dd5326aecbe5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.271399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb843f-e05e-491a-ad99-ca7c60183d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.272373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb843f-e05e-491a-ad99-ca7c60183d6d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.272651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb843f-e05e-491a-ad99-ca7c60183d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.272973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb843f-e05e-491a-ad99-ca7c60183d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.273928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb843f-e05e-491a-ad99-ca7c60183d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.276486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb843f-e05e-491a-ad99-ca7c60183d6d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.307862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 790/1576] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.311938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb843f-e05e-491a-ad99-ca7c60183d6d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.318933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0af782-5140-4dff-822b-1cdd1b1c57fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.319961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0af782-5140-4dff-822b-1cdd1b1c57fb admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.320388 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0af782-5140-4dff-822b-1cdd1b1c57fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.320835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0af782-5140-4dff-822b-1cdd1b1c57fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.321950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0af782-5140-4dff-822b-1cdd1b1c57fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.325259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0af782-5140-4dff-822b-1cdd1b1c57fb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.357430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 787/1577] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.357430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5898-8fc3-4b2c-8b71-d445d8b801a4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.357430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5898-8fc3-4b2c-8b71-d445d8b801a4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.357430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5898-8fc3-4b2c-8b71-d445d8b801a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.362761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:30.381393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb843f-e05e-491a-ad99-ca7c60183d6d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.382941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1a5b5898-8fc3-4b2c-8b71-d445d8b801a4 None None] MFA Rules not processed for user `ca34c50cd12e42a28c3cfe7c434e4113`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:30.384572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1a5b5898-8fc3-4b2c-8b71-d445d8b801a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:30.439647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea928f-be96-4273-aae9-cd4393f1ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.440317 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea928f-be96-4273-aae9-cd4393f1ca61 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.440594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea928f-be96-4273-aae9-cd4393f1ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.441362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea928f-be96-4273-aae9-cd4393f1ca61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.441566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea928f-be96-4273-aae9-cd4393f1ca61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.443512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea928f-be96-4273-aae9-cd4393f1ca61 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.450442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 788/1578] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:30.451649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b5898-8fc3-4b2c-8b71-d445d8b801a4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.462794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b5898-8fc3-4b2c-8b71-d445d8b801a4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.468928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7fcb6-44e9-450c-b132-fa49320e054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.469632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fcb6-44e9-450c-b132-fa49320e054c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.469914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fcb6-44e9-450c-b132-fa49320e054c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.470186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fcb6-44e9-450c-b132-fa49320e054c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.470889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7fcb6-44e9-450c-b132-fa49320e054c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.472866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7fcb6-44e9-450c-b132-fa49320e054c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.481809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 791/1579] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.481809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea928f-be96-4273-aae9-cd4393f1ca61 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.498189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 789/1580] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.499583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7fcb6-44e9-450c-b132-fa49320e054c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.512881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7fcb6-44e9-450c-b132-fa49320e054c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.555303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea928f-be96-4273-aae9-cd4393f1ca61 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.561375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98100cf9-c3d1-4a04-8b48-32e464fd004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.561916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98100cf9-c3d1-4a04-8b48-32e464fd004f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.562201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98100cf9-c3d1-4a04-8b48-32e464fd004f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.562482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98100cf9-c3d1-4a04-8b48-32e464fd004f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.563214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98100cf9-c3d1-4a04-8b48-32e464fd004f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.565173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98100cf9-c3d1-4a04-8b48-32e464fd004f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.573762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6409-5771-4f24-bcda-1a823b853bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.574477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6409-5771-4f24-bcda-1a823b853bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.574757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6409-5771-4f24-bcda-1a823b853bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.575057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6409-5771-4f24-bcda-1a823b853bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.575758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b6409-5771-4f24-bcda-1a823b853bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.578617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b6409-5771-4f24-bcda-1a823b853bd5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.589527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:30.598014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 792/1581] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.599424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e2c0-b531-4c3a-bc96-4a7204d83f75 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.599755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e2c0-b531-4c3a-bc96-4a7204d83f75 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.599988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e2c0-b531-4c3a-bc96-4a7204d83f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.609731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 790/1582] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.611195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6409-5771-4f24-bcda-1a823b853bd5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.625014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6409-5771-4f24-bcda-1a823b853bd5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.632334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8107e2c0-b531-4c3a-bc96-4a7204d83f75 None None] MFA Rules not processed for user `7e1520127f034619b03f909614251503`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:30.633593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8107e2c0-b531-4c3a-bc96-4a7204d83f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:30.693091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:30.697595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea4740-615a-4f41-87bd-40c00f0fd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.698540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4740-615a-4f41-87bd-40c00f0fd745 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.699076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4740-615a-4f41-87bd-40c00f0fd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.699462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea4740-615a-4f41-87bd-40c00f0fd745 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.700498 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea4740-615a-4f41-87bd-40c00f0fd745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.703764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea4740-615a-4f41-87bd-40c00f0fd745 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.713662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 793/1583] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:30.714835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107e2c0-b531-4c3a-bc96-4a7204d83f75 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.727335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107e2c0-b531-4c3a-bc96-4a7204d83f75 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.732782 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 791/1584] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.732942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecce79-c87c-4de2-9f23-f012599c76f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.733651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecce79-c87c-4de2-9f23-f012599c76f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.733961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecce79-c87c-4de2-9f23-f012599c76f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.734240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecce79-c87c-4de2-9f23-f012599c76f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.735124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecce79-c87c-4de2-9f23-f012599c76f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.737244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecce79-c87c-4de2-9f23-f012599c76f4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.737941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4789-71df-4b61-9e69-28c4ecb29358 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.738357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4789-71df-4b61-9e69-28c4ecb29358 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.738534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4789-71df-4b61-9e69-28c4ecb29358 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.739916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 792/1585] 10.222.0.47 () {54 vars in 962 bytes} [Wed Jul 20 15:28:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:30.740767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a4789-71df-4b61-9e69-28c4ecb29358 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.758661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a4789-71df-4b61-9e69-28c4ecb29358 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.766165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 794/1586] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.767027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099824f-08d6-4aac-a129-a78df6525a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.767157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecce79-c87c-4de2-9f23-f012599c76f4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.767995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099824f-08d6-4aac-a129-a78df6525a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.768282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099824f-08d6-4aac-a129-a78df6525a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.768558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099824f-08d6-4aac-a129-a78df6525a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.769286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099824f-08d6-4aac-a129-a78df6525a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.771864 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099824f-08d6-4aac-a129-a78df6525a78 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.780415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecce79-c87c-4de2-9f23-f012599c76f4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.785984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cf5fd-5d7b-4ca3-866f-82de6c9427dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.786749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf5fd-5d7b-4ca3-866f-82de6c9427dc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.787072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf5fd-5d7b-4ca3-866f-82de6c9427dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.787352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf5fd-5d7b-4ca3-866f-82de6c9427dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.788086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf5fd-5d7b-4ca3-866f-82de6c9427dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.789716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf5fd-5d7b-4ca3-866f-82de6c9427dc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.793210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 793/1587] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/users => generated 288 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.794021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099824f-08d6-4aac-a129-a78df6525a78 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.800469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 795/1588] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:30.804030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cf5fd-5d7b-4ca3-866f-82de6c9427dc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.807845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099824f-08d6-4aac-a129-a78df6525a78 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.812705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53f822-fe94-490d-9e68-4abf3af1d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.813366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f822-fe94-490d-9e68-4abf3af1d470 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.813637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f822-fe94-490d-9e68-4abf3af1d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.813907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f822-fe94-490d-9e68-4abf3af1d470 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.814270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cf5fd-5d7b-4ca3-866f-82de6c9427dc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.814599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53f822-fe94-490d-9e68-4abf3af1d470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.816568 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53f822-fe94-490d-9e68-4abf3af1d470 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.818930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83423-2137-48e7-9c8e-59283905938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.819628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83423-2137-48e7-9c8e-59283905938c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.819911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83423-2137-48e7-9c8e-59283905938c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.820186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83423-2137-48e7-9c8e-59283905938c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.820916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c83423-2137-48e7-9c8e-59283905938c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.822592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c83423-2137-48e7-9c8e-59283905938c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.835288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 796/1589] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:30.836162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83423-2137-48e7-9c8e-59283905938c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.842837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 794/1590] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:30.842837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620fd0f-990f-4b69-9cf9-70a30f7ebdb0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.842837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620fd0f-990f-4b69-9cf9-70a30f7ebdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.842837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620fd0f-990f-4b69-9cf9-70a30f7ebdb0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.846284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83423-2137-48e7-9c8e-59283905938c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.847141 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 795/1591] 10.222.0.47 () {54 vars in 962 bytes} [Wed Jul 20 15:28:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:30.848409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b8ba2-00da-454d-9297-055126c28e42 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.848722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b8ba2-00da-454d-9297-055126c28e42 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.848998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b8ba2-00da-454d-9297-055126c28e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.851925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6c9f2-0b51-4d9e-9aa9-978e44ee1745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.852531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6c9f2-0b51-4d9e-9aa9-978e44ee1745 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.852998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6c9f2-0b51-4d9e-9aa9-978e44ee1745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.853283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6c9f2-0b51-4d9e-9aa9-978e44ee1745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.854073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6c9f2-0b51-4d9e-9aa9-978e44ee1745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.856762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6c9f2-0b51-4d9e-9aa9-978e44ee1745 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.868709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 797/1592] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:30.869587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6c9f2-0b51-4d9e-9aa9-978e44ee1745 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.880391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6c9f2-0b51-4d9e-9aa9-978e44ee1745 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.885196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d9532-08bb-43b4-874c-c0cb49c31179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.885858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9532-08bb-43b4-874c-c0cb49c31179 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.886141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9532-08bb-43b4-874c-c0cb49c31179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.886417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9532-08bb-43b4-874c-c0cb49c31179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.887189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d9532-08bb-43b4-874c-c0cb49c31179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.888923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d9532-08bb-43b4-874c-c0cb49c31179 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.892322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a66b8ba2-00da-454d-9297-055126c28e42 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:30.893555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a66b8ba2-00da-454d-9297-055126c28e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:30.901689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 798/1593] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:30.901689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d9532-08bb-43b4-874c-c0cb49c31179 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.912097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d9532-08bb-43b4-874c-c0cb49c31179 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.919649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989c27-f6b4-4626-98a1-c0d16b0f06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.920383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989c27-f6b4-4626-98a1-c0d16b0f06a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.921589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989c27-f6b4-4626-98a1-c0d16b0f06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.921881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989c27-f6b4-4626-98a1-c0d16b0f06a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.922640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5989c27-f6b4-4626-98a1-c0d16b0f06a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.924427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5989c27-f6b4-4626-98a1-c0d16b0f06a0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.939232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 799/1594] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:30.940436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989c27-f6b4-4626-98a1-c0d16b0f06a0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.954208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989c27-f6b4-4626-98a1-c0d16b0f06a0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.960472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7ca85-7b80-4405-ae4d-c2ff8c665b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.961234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7ca85-7b80-4405-ae4d-c2ff8c665b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.961592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7ca85-7b80-4405-ae4d-c2ff8c665b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.961871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7ca85-7b80-4405-ae4d-c2ff8c665b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.962671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7ca85-7b80-4405-ae4d-c2ff8c665b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.964388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7ca85-7b80-4405-ae4d-c2ff8c665b9f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.975129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 800/1595] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:30.976043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7ca85-7b80-4405-ae4d-c2ff8c665b9f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.978319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 796/1596] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Jul 20 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:30.979474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b8ba2-00da-454d-9297-055126c28e42 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:30.987292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7ca85-7b80-4405-ae4d-c2ff8c665b9f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.990696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b8ba2-00da-454d-9297-055126c28e42 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:30.992552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9853b0-ed65-4105-925b-35c9df3214fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.993246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9853b0-ed65-4105-925b-35c9df3214fa admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.993511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9853b0-ed65-4105-925b-35c9df3214fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.993787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9853b0-ed65-4105-925b-35c9df3214fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.994526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9853b0-ed65-4105-925b-35c9df3214fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.995532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01991-4750-45c5-a5ab-82490fedad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:30.996540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01991-4750-45c5-a5ab-82490fedad0c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:30.996648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9853b0-ed65-4105-925b-35c9df3214fa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:30.996829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01991-4750-45c5-a5ab-82490fedad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:30.997098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01991-4750-45c5-a5ab-82490fedad0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:30.997936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa01991-4750-45c5-a5ab-82490fedad0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:30.999546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa01991-4750-45c5-a5ab-82490fedad0c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.007135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 801/1597] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:31.008437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2260-046e-4896-848a-a94e04256122 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.008728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2260-046e-4896-848a-a94e04256122 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.009011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f2260-046e-4896-848a-a94e04256122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.013061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 797/1598] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:31.013061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01991-4750-45c5-a5ab-82490fedad0c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.021000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01991-4750-45c5-a5ab-82490fedad0c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.025815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701b7fd-a823-4282-8e76-c542377cad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.026486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b7fd-a823-4282-8e76-c542377cad74 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.026771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b7fd-a823-4282-8e76-c542377cad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.027070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b7fd-a823-4282-8e76-c542377cad74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.027811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701b7fd-a823-4282-8e76-c542377cad74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.029431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701b7fd-a823-4282-8e76-c542377cad74 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.031340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-699f2260-046e-4896-848a-a94e04256122 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:31.032551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-699f2260-046e-4896-848a-a94e04256122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:31.040168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 798/1599] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:31.041099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701b7fd-a823-4282-8e76-c542377cad74 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.043684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 802/1600] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Jul 20 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:31.044615 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f2260-046e-4896-848a-a94e04256122 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.052679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701b7fd-a823-4282-8e76-c542377cad74 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.057263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f2260-046e-4896-848a-a94e04256122 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.057477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6d2fb-d8ab-42b3-91f6-199a1eb8011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.058196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6d2fb-d8ab-42b3-91f6-199a1eb8011f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.058471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6d2fb-d8ab-42b3-91f6-199a1eb8011f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.058735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6d2fb-d8ab-42b3-91f6-199a1eb8011f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.059891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6d2fb-d8ab-42b3-91f6-199a1eb8011f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.061627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6d2fb-d8ab-42b3-91f6-199a1eb8011f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.063319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:31.063469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639d56-645d-4699-a0ce-a1fff1dff1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.063990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639d56-645d-4699-a0ce-a1fff1dff1aa admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.064310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639d56-645d-4699-a0ce-a1fff1dff1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.064589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639d56-645d-4699-a0ce-a1fff1dff1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.065281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad639d56-645d-4699-a0ce-a1fff1dff1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.066957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad639d56-645d-4699-a0ce-a1fff1dff1aa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.076342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 799/1601] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:31.077137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6d2fb-d8ab-42b3-91f6-199a1eb8011f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.081669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 803/1602] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:31.081669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639d56-645d-4699-a0ce-a1fff1dff1aa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.088574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6d2fb-d8ab-42b3-91f6-199a1eb8011f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.092271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639d56-645d-4699-a0ce-a1fff1dff1aa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.093882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91214f8-e156-4d04-9531-74c33b190167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.094776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91214f8-e156-4d04-9531-74c33b190167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.095090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91214f8-e156-4d04-9531-74c33b190167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.095367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91214f8-e156-4d04-9531-74c33b190167 admin admin] PATH_INFO: `/v3/projects/5fa930fe9b5542d09fded8e0ebe57994/users/8fea7edff657444ba5ae56a8657b0834/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.097908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb480-17b3-4de3-bb5b-7be4de6d33b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.098588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb480-17b3-4de3-bb5b-7be4de6d33b6 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.099807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb480-17b3-4de3-bb5b-7be4de6d33b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.099807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb480-17b3-4de3-bb5b-7be4de6d33b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.112036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91214f8-e156-4d04-9531-74c33b190167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa930fe9b5542d09fded8e0ebe57994, user_id=8fea7edff657444ba5ae56a8657b0834, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.114744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91214f8-e156-4d04-9531-74c33b190167 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.134041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 800/1603] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:31 2022] PUT /identity/v3/projects/5fa930fe9b5542d09fded8e0ebe57994/users/8fea7edff657444ba5ae56a8657b0834/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:31.134638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91214f8-e156-4d04-9531-74c33b190167 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.163189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb480-17b3-4de3-bb5b-7be4de6d33b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.164837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb480-17b3-4de3-bb5b-7be4de6d33b6 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.176836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 804/1604] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:31.178459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb480-17b3-4de3-bb5b-7be4de6d33b6 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.194111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb480-17b3-4de3-bb5b-7be4de6d33b6 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.217843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91214f8-e156-4d04-9531-74c33b190167 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.223845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c831b6-f5ed-4bb0-8331-4ddbeec0ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.224754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c831b6-f5ed-4bb0-8331-4ddbeec0ae01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.225035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c831b6-f5ed-4bb0-8331-4ddbeec0ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.225473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c831b6-f5ed-4bb0-8331-4ddbeec0ae01 admin admin] PATH_INFO: `/v3/projects/7f41024b0cc644feb998187eb4bd27ed/users/146eac4a1ce04cb9a67522caea62ffa7/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.238125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:31.242126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c831b6-f5ed-4bb0-8331-4ddbeec0ae01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f41024b0cc644feb998187eb4bd27ed, user_id=146eac4a1ce04cb9a67522caea62ffa7, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.245032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c831b6-f5ed-4bb0-8331-4ddbeec0ae01 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.262265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 801/1605] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:31 2022] PUT /identity/v3/projects/7f41024b0cc644feb998187eb4bd27ed/users/146eac4a1ce04cb9a67522caea62ffa7/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:31.264025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c831b6-f5ed-4bb0-8331-4ddbeec0ae01 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.273132 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3547-1aad-4789-84a7-75f5537a208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.274107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3547-1aad-4789-84a7-75f5537a208f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.274577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3547-1aad-4789-84a7-75f5537a208f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.275066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec3547-1aad-4789-84a7-75f5537a208f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.275639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec3547-1aad-4789-84a7-75f5537a208f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.277379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec3547-1aad-4789-84a7-75f5537a208f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.289260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 805/1606] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:31.291947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3547-1aad-4789-84a7-75f5537a208f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.343729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c831b6-f5ed-4bb0-8331-4ddbeec0ae01 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.350088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f5642-eebb-4673-8f91-3075f783bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.351630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f5642-eebb-4673-8f91-3075f783bd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.351918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f5642-eebb-4673-8f91-3075f783bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.352208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f5642-eebb-4673-8f91-3075f783bd8c admin admin] PATH_INFO: `/v3/projects/807e5b338e6e49b8bc16340edc14baa2/users/4eca399e504a451e8925f13d3e156be3/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.375240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec3547-1aad-4789-84a7-75f5537a208f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.375893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f5642-eebb-4673-8f91-3075f783bd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=807e5b338e6e49b8bc16340edc14baa2, user_id=4eca399e504a451e8925f13d3e156be3, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.378779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f5642-eebb-4673-8f91-3075f783bd8c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.395496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 802/1607] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:31 2022] PUT /identity/v3/projects/807e5b338e6e49b8bc16340edc14baa2/users/4eca399e504a451e8925f13d3e156be3/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:31.400086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f5642-eebb-4673-8f91-3075f783bd8c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.446550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632f1b5-9517-403c-a0c9-4d0c9914193f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.447240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:31.447635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632f1b5-9517-403c-a0c9-4d0c9914193f service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.447928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632f1b5-9517-403c-a0c9-4d0c9914193f service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.448207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632f1b5-9517-403c-a0c9-4d0c9914193f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.471312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f5642-eebb-4673-8f91-3075f783bd8c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.476111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a965a2-4381-48e4-859a-c85270def577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.477032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a965a2-4381-48e4-859a-c85270def577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.477320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a965a2-4381-48e4-859a-c85270def577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.477748 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a965a2-4381-48e4-859a-c85270def577 admin admin] PATH_INFO: `/v3/projects/7eb9db15010b4ff1aeaa1d7ce22f4fa1/users/00bded549c2d4dc88b5a4871eb155655/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.494034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a965a2-4381-48e4-859a-c85270def577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb9db15010b4ff1aeaa1d7ce22f4fa1, user_id=00bded549c2d4dc88b5a4871eb155655, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.497221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a965a2-4381-48e4-859a-c85270def577 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.510908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632f1b5-9517-403c-a0c9-4d0c9914193f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.512599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632f1b5-9517-403c-a0c9-4d0c9914193f service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.512906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 803/1608] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:31 2022] PUT /identity/v3/projects/7eb9db15010b4ff1aeaa1d7ce22f4fa1/users/00bded549c2d4dc88b5a4871eb155655/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:31.513738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a965a2-4381-48e4-859a-c85270def577 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.523386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 806/1609] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:31.524769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dcba4-27e0-425b-b059-7561e2e829b9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.525062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dcba4-27e0-425b-b059-7561e2e829b9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.525393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dcba4-27e0-425b-b059-7561e2e829b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.544525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-711dcba4-27e0-425b-b059-7561e2e829b9 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:31.545860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-711dcba4-27e0-425b-b059-7561e2e829b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:31.550656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:31.608607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a965a2-4381-48e4-859a-c85270def577 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.614111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeccd29-f3bd-42e7-a0e9-03cb8fb0b4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.615468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeccd29-f3bd-42e7-a0e9-03cb8fb0b4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.615977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeccd29-f3bd-42e7-a0e9-03cb8fb0b4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.616421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeccd29-f3bd-42e7-a0e9-03cb8fb0b4d8 admin admin] PATH_INFO: `/v3/projects/eb4d02c8ce6f438985148f67a689331e/users/4db0b3e2b8dd4a2d83316d1cb331598b/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.617240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 807/1610] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:31.618331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6537-cba3-47f5-a905-73a19e23977c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.618619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6537-cba3-47f5-a905-73a19e23977c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.618897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6537-cba3-47f5-a905-73a19e23977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.641555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeccd29-f3bd-42e7-a0e9-03cb8fb0b4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4d02c8ce6f438985148f67a689331e, user_id=4db0b3e2b8dd4a2d83316d1cb331598b, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.644379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeccd29-f3bd-42e7-a0e9-03cb8fb0b4d8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.648856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ba8f6537-cba3-47f5-a905-73a19e23977c None None] MFA Rules not processed for user `146eac4a1ce04cb9a67522caea62ffa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:31.650102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba8f6537-cba3-47f5-a905-73a19e23977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:31.660658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 804/1611] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:31 2022] PUT /identity/v3/projects/eb4d02c8ce6f438985148f67a689331e/users/4db0b3e2b8dd4a2d83316d1cb331598b/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:31.672439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeccd29-f3bd-42e7-a0e9-03cb8fb0b4d8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.720772 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 808/1612] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:31.722494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1bee1-d740-4611-8c80-d004c9a7fa85 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.722779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1bee1-d740-4611-8c80-d004c9a7fa85 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.723090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1bee1-d740-4611-8c80-d004c9a7fa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.744020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-66d1bee1-d740-4611-8c80-d004c9a7fa85 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:31.745239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-66d1bee1-d740-4611-8c80-d004c9a7fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:31.748201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeccd29-f3bd-42e7-a0e9-03cb8fb0b4d8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.754291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 809/1613] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:31.754515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebaf05-523d-4fec-a322-50f1e1351b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.755585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebaf05-523d-4fec-a322-50f1e1351b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.755863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebaf05-523d-4fec-a322-50f1e1351b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.755986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35000542-7e15-4966-af1f-c0c7cf1433f7 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.756139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebaf05-523d-4fec-a322-50f1e1351b5f admin admin] PATH_INFO: `/v3/projects/1fc629a24f99430a90c6159cdce3109a/users/73d641511ee544b8a5bd055143154b1e/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.756427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35000542-7e15-4966-af1f-c0c7cf1433f7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.756805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35000542-7e15-4966-af1f-c0c7cf1433f7 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.758574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 810/1614] 10.222.0.47 () {54 vars in 912 bytes} [Wed Jul 20 15:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:31.760673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206ceb-8896-4ac4-b710-9ecb901328e6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.761277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206ceb-8896-4ac4-b710-9ecb901328e6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.761865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206ceb-8896-4ac4-b710-9ecb901328e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.778795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebaf05-523d-4fec-a322-50f1e1351b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc629a24f99430a90c6159cdce3109a, user_id=73d641511ee544b8a5bd055143154b1e, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.781684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebaf05-523d-4fec-a322-50f1e1351b5f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.791592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-05206ceb-8896-4ac4-b710-9ecb901328e6 None None] MFA Rules not processed for user `00bded549c2d4dc88b5a4871eb155655`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:31.792811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-05206ceb-8896-4ac4-b710-9ecb901328e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:31.797009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 805/1615] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:31 2022] PUT /identity/v3/projects/1fc629a24f99430a90c6159cdce3109a/users/73d641511ee544b8a5bd055143154b1e/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:31.797802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebaf05-523d-4fec-a322-50f1e1351b5f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.830519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:31.859407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebaf05-523d-4fec-a322-50f1e1351b5f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.863095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b527-aa85-45a9-ae8f-82639c204907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.863907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b527-aa85-45a9-ae8f-82639c204907 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.864269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b527-aa85-45a9-ae8f-82639c204907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.864553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b527-aa85-45a9-ae8f-82639c204907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.866294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 811/1616] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:31.867631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5ae4-b026-496c-aa3a-9fcfc9ed14a8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.868064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5ae4-b026-496c-aa3a-9fcfc9ed14a8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.868370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b5ae4-b026-496c-aa3a-9fcfc9ed14a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.903288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ae2b5ae4-b026-496c-aa3a-9fcfc9ed14a8 None None] MFA Rules not processed for user `4db0b3e2b8dd4a2d83316d1cb331598b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:31.904634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae2b5ae4-b026-496c-aa3a-9fcfc9ed14a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:31.914331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:31.952270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082b527-aa85-45a9-ae8f-82639c204907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:31.954583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082b527-aa85-45a9-ae8f-82639c204907 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:31.969145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 806/1617] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:31.970425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b527-aa85-45a9-ae8f-82639c204907 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:31.985784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b527-aa85-45a9-ae8f-82639c204907 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:31.989251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 812/1618] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:31.990616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3aa2f-fa7f-4a10-8a17-1be4948ef450 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:31.990999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3aa2f-fa7f-4a10-8a17-1be4948ef450 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:31.991303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3aa2f-fa7f-4a10-8a17-1be4948ef450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:31.999230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd0f96-7a64-4e2f-aceb-be62d76cef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:31.999955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd0f96-7a64-4e2f-aceb-be62d76cef6e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.000340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd0f96-7a64-4e2f-aceb-be62d76cef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.000548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd0f96-7a64-4e2f-aceb-be62d76cef6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.001302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd0f96-7a64-4e2f-aceb-be62d76cef6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.003474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd0f96-7a64-4e2f-aceb-be62d76cef6e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.013413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-48f3aa2f-fa7f-4a10-8a17-1be4948ef450 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:32.014665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-48f3aa2f-fa7f-4a10-8a17-1be4948ef450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:32.035492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 807/1619] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:31 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:32.036502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd0f96-7a64-4e2f-aceb-be62d76cef6e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.111665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd0f96-7a64-4e2f-aceb-be62d76cef6e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.114433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 813/1620] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:32.115710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2d59b-e6c1-465d-b3b0-a73ec6dd233f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.115859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58198b-234a-4ea3-a9ad-7da76d4ae4a3 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.116195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58198b-234a-4ea3-a9ad-7da76d4ae4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.116522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d59b-e6c1-465d-b3b0-a73ec6dd233f service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.116638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58198b-234a-4ea3-a9ad-7da76d4ae4a3 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.116799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d59b-e6c1-465d-b3b0-a73ec6dd233f service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.117078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d59b-e6c1-465d-b3b0-a73ec6dd233f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.118228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 814/1621] 10.222.0.47 () {54 vars in 912 bytes} [Wed Jul 20 15:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:32.123992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46f6a-c8ec-4ea1-b7a8-fe72bfe7260e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.124365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46f6a-c8ec-4ea1-b7a8-fe72bfe7260e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.125476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46f6a-c8ec-4ea1-b7a8-fe72bfe7260e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.167696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c1b46f6a-c8ec-4ea1-b7a8-fe72bfe7260e None None] MFA Rules not processed for user `73d641511ee544b8a5bd055143154b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:32.169803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c1b46f6a-c8ec-4ea1-b7a8-fe72bfe7260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:32.217560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2d59b-e6c1-465d-b3b0-a73ec6dd233f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.219949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2d59b-e6c1-465d-b3b0-a73ec6dd233f service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.240605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 808/1622] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:32.242079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2d59b-e6c1-465d-b3b0-a73ec6dd233f service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.251301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:32.252659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 815/1623] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:32.256273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2d59b-e6c1-465d-b3b0-a73ec6dd233f service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.256972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b46f6a-c8ec-4ea1-b7a8-fe72bfe7260e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.263785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef112345-94e5-4fc3-86c6-2776c0766773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.264489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef112345-94e5-4fc3-86c6-2776c0766773 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.264919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef112345-94e5-4fc3-86c6-2776c0766773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.265712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef112345-94e5-4fc3-86c6-2776c0766773 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.266908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef112345-94e5-4fc3-86c6-2776c0766773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.269784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b46f6a-c8ec-4ea1-b7a8-fe72bfe7260e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.271327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef112345-94e5-4fc3-86c6-2776c0766773 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.278007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f2896-0259-44ba-b9f3-742851657d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.279086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f2896-0259-44ba-b9f3-742851657d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.279716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f2896-0259-44ba-b9f3-742851657d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.280062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f2896-0259-44ba-b9f3-742851657d03 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.280807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f2896-0259-44ba-b9f3-742851657d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.284810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f2896-0259-44ba-b9f3-742851657d03 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.304264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 809/1624] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:32 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:32.306098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b078d1-e4ea-45cc-8b88-4255c5ffb0f6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.306614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b078d1-e4ea-45cc-8b88-4255c5ffb0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.307032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b078d1-e4ea-45cc-8b88-4255c5ffb0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.312432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 816/1625] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:32 2022] POST /identity/v3/users => generated 295 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:32.313446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f2896-0259-44ba-b9f3-742851657d03 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.331220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-81b078d1-e4ea-45cc-8b88-4255c5ffb0f6 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:32.333006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-81b078d1-e4ea-45cc-8b88-4255c5ffb0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:32.345037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:32.411034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f2896-0259-44ba-b9f3-742851657d03 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.434728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 810/1626] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:32.435960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b078d1-e4ea-45cc-8b88-4255c5ffb0f6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.500721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dd500-ebf4-49f5-b696-6d85b59f8cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.501668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dd500-ebf4-49f5-b696-6d85b59f8cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.502046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dd500-ebf4-49f5-b696-6d85b59f8cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.502497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dd500-ebf4-49f5-b696-6d85b59f8cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.518325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932dd500-ebf4-49f5-b696-6d85b59f8cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.520024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932dd500-ebf4-49f5-b696-6d85b59f8cd4 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.536743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 817/1627] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:32.537810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dd500-ebf4-49f5-b696-6d85b59f8cd4 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.606858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b078d1-e4ea-45cc-8b88-4255c5ffb0f6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.624764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb824d-fbb0-4571-aafe-9d76a6d92eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.625459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb824d-fbb0-4571-aafe-9d76a6d92eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.625818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb824d-fbb0-4571-aafe-9d76a6d92eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.626078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb824d-fbb0-4571-aafe-9d76a6d92eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.630070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb824d-fbb0-4571-aafe-9d76a6d92eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.643199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb824d-fbb0-4571-aafe-9d76a6d92eb2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.705012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 811/1628] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:32 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:32.709799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb824d-fbb0-4571-aafe-9d76a6d92eb2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.726847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dd500-ebf4-49f5-b696-6d85b59f8cd4 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.819429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52439dff-6e70-4993-80bb-c25d2db5026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.821703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52439dff-6e70-4993-80bb-c25d2db5026f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.822335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52439dff-6e70-4993-80bb-c25d2db5026f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.823041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52439dff-6e70-4993-80bb-c25d2db5026f admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.824238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52439dff-6e70-4993-80bb-c25d2db5026f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.826426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52439dff-6e70-4993-80bb-c25d2db5026f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.879441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 818/1629] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:32 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:32.881017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52439dff-6e70-4993-80bb-c25d2db5026f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.890722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb824d-fbb0-4571-aafe-9d76a6d92eb2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.899222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefcce5-118c-4a1c-9c31-b9af02f93193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.900249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefcce5-118c-4a1c-9c31-b9af02f93193 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.900703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefcce5-118c-4a1c-9c31-b9af02f93193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.901159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefcce5-118c-4a1c-9c31-b9af02f93193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.902866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefcce5-118c-4a1c-9c31-b9af02f93193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.915239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:32.919645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefcce5-118c-4a1c-9c31-b9af02f93193 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.921795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:32.943010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 812/1630] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:32.944972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefcce5-118c-4a1c-9c31-b9af02f93193 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.970384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefcce5-118c-4a1c-9c31-b9af02f93193 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.984640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076316-b504-4871-8215-4b2c07450eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.985861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076316-b504-4871-8215-4b2c07450eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.986436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076316-b504-4871-8215-4b2c07450eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.987252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076316-b504-4871-8215-4b2c07450eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.988877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f076316-b504-4871-8215-4b2c07450eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.991693 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f076316-b504-4871-8215-4b2c07450eb2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.001104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52439dff-6e70-4993-80bb-c25d2db5026f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.007632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8baa86-920c-412c-8f8b-cb6ddc32bf2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.008941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8baa86-920c-412c-8f8b-cb6ddc32bf2f service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.009453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8baa86-920c-412c-8f8b-cb6ddc32bf2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.010128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8baa86-920c-412c-8f8b-cb6ddc32bf2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.034509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 813/1631] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:32 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:33.037450 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076316-b504-4871-8215-4b2c07450eb2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.051605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076316-b504-4871-8215-4b2c07450eb2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.058801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da42f-fccb-4cee-b054-c838e9a214d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.059703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da42f-fccb-4cee-b054-c838e9a214d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.060079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da42f-fccb-4cee-b054-c838e9a214d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.060450 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da42f-fccb-4cee-b054-c838e9a214d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.061341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2da42f-fccb-4cee-b054-c838e9a214d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.063261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2da42f-fccb-4cee-b054-c838e9a214d2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.081597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 814/1632] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:33.083207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da42f-fccb-4cee-b054-c838e9a214d2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.095823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da42f-fccb-4cee-b054-c838e9a214d2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.104195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298ec6-9f58-4229-8f5b-9791fb17fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.105536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298ec6-9f58-4229-8f5b-9791fb17fc29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.106606 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298ec6-9f58-4229-8f5b-9791fb17fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.107375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298ec6-9f58-4229-8f5b-9791fb17fc29 admin admin] PATH_INFO: `/v3/projects/ba5f451f73cb41acaea0097cf2342c34/users/37f0281bb2d54880ac7bf2ede68050c9/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.140344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298ec6-9f58-4229-8f5b-9791fb17fc29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5f451f73cb41acaea0097cf2342c34, user_id=37f0281bb2d54880ac7bf2ede68050c9, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.146234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298ec6-9f58-4229-8f5b-9791fb17fc29 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.177591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 815/1633] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:33 2022] PUT /identity/v3/projects/ba5f451f73cb41acaea0097cf2342c34/users/37f0281bb2d54880ac7bf2ede68050c9/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:33.177591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298ec6-9f58-4229-8f5b-9791fb17fc29 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.188043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8baa86-920c-412c-8f8b-cb6ddc32bf2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.192225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8baa86-920c-412c-8f8b-cb6ddc32bf2f service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.221564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 819/1634] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:33.222429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8baa86-920c-412c-8f8b-cb6ddc32bf2f service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.242456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8baa86-920c-412c-8f8b-cb6ddc32bf2f service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.377911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298ec6-9f58-4229-8f5b-9791fb17fc29 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.383756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75099353-e1c1-4e96-af3b-e651d87631cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.384901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75099353-e1c1-4e96-af3b-e651d87631cf admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.385220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75099353-e1c1-4e96-af3b-e651d87631cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.385501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75099353-e1c1-4e96-af3b-e651d87631cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.386454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75099353-e1c1-4e96-af3b-e651d87631cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.388182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75099353-e1c1-4e96-af3b-e651d87631cf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.393481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e9ffd-8d38-42c2-948d-dfc5f7d848da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.394408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e9ffd-8d38-42c2-948d-dfc5f7d848da admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.394691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e9ffd-8d38-42c2-948d-dfc5f7d848da admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.394984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e9ffd-8d38-42c2-948d-dfc5f7d848da admin admin] PATH_INFO: `/v3/projects/23e107d5fca048a1957a4824043e43d6/users/ca2cfdb9ad714ef1a5ead186d63a9c6b/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.402337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 816/1635] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:33.403508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75099353-e1c1-4e96-af3b-e651d87631cf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.417774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75099353-e1c1-4e96-af3b-e651d87631cf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.425312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eecc24-bf46-4433-86d8-63ae5c6165fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.426267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecc24-bf46-4433-86d8-63ae5c6165fb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.426834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecc24-bf46-4433-86d8-63ae5c6165fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.427194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecc24-bf46-4433-86d8-63ae5c6165fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.428320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eecc24-bf46-4433-86d8-63ae5c6165fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.430660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eecc24-bf46-4433-86d8-63ae5c6165fb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.433554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e9ffd-8d38-42c2-948d-dfc5f7d848da admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e107d5fca048a1957a4824043e43d6, user_id=ca2cfdb9ad714ef1a5ead186d63a9c6b, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.437006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e9ffd-8d38-42c2-948d-dfc5f7d848da admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.448761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 817/1636] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:33.450095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eecc24-bf46-4433-86d8-63ae5c6165fb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.467536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 820/1637] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:33 2022] PUT /identity/v3/projects/23e107d5fca048a1957a4824043e43d6/users/ca2cfdb9ad714ef1a5ead186d63a9c6b/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:33.467536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e9ffd-8d38-42c2-948d-dfc5f7d848da admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.467848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eecc24-bf46-4433-86d8-63ae5c6165fb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.575020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:33.650058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315fb3-1229-473d-a0f5-4f905ab1de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.651469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315fb3-1229-473d-a0f5-4f905ab1de2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.653360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315fb3-1229-473d-a0f5-4f905ab1de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.653679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315fb3-1229-473d-a0f5-4f905ab1de2f admin admin] PATH_INFO: `/v3/projects/991e6f7cdad842aaa3d1106573bfb0ad/users/dde73c37e6f6410aae7f68bf9c712ad9/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.659264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e9ffd-8d38-42c2-948d-dfc5f7d848da admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.677554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a3d1b-4814-4568-a71f-041d01f5acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.679538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3d1b-4814-4568-a71f-041d01f5acef admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.679958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3d1b-4814-4568-a71f-041d01f5acef admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.680340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3d1b-4814-4568-a71f-041d01f5acef admin admin] PATH_INFO: `/v3/projects/ba5f451f73cb41acaea0097cf2342c34/users/37f0281bb2d54880ac7bf2ede68050c9/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.685693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a3d1b-4814-4568-a71f-041d01f5acef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5f451f73cb41acaea0097cf2342c34, user_id=37f0281bb2d54880ac7bf2ede68050c9, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.691413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f315fb3-1229-473d-a0f5-4f905ab1de2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=991e6f7cdad842aaa3d1106573bfb0ad, user_id=dde73c37e6f6410aae7f68bf9c712ad9, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.697429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a3d1b-4814-4568-a71f-041d01f5acef admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.697710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f315fb3-1229-473d-a0f5-4f905ab1de2f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:33.725514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 818/1638] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:33 2022] PUT /identity/v3/projects/991e6f7cdad842aaa3d1106573bfb0ad/users/dde73c37e6f6410aae7f68bf9c712ad9/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:33.729191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315fb3-1229-473d-a0f5-4f905ab1de2f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.751013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 821/1639] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:33 2022] PUT /identity/v3/projects/ba5f451f73cb41acaea0097cf2342c34/users/37f0281bb2d54880ac7bf2ede68050c9/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:33.751013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a3d1b-4814-4568-a71f-041d01f5acef admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:33.760595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:33.875334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f315fb3-1229-473d-a0f5-4f905ab1de2f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.963094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a3d1b-4814-4568-a71f-041d01f5acef admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:33.972243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f519f4c-54c0-4819-b37b-0b3c98803c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:33.973346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519f4c-54c0-4819-b37b-0b3c98803c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:33.973815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519f4c-54c0-4819-b37b-0b3c98803c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:33.974325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519f4c-54c0-4819-b37b-0b3c98803c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:33.975972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f519f4c-54c0-4819-b37b-0b3c98803c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:33.978397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f519f4c-54c0-4819-b37b-0b3c98803c19 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:34.010671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 822/1640] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:34.012272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a29b0-fef6-45fc-994f-189aafbc07c9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.012552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a29b0-fef6-45fc-994f-189aafbc07c9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.012825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a29b0-fef6-45fc-994f-189aafbc07c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.048155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16fe96-106d-4ae8-90bc-184ae1249976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:34.049337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16fe96-106d-4ae8-90bc-184ae1249976 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.049858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16fe96-106d-4ae8-90bc-184ae1249976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.050408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16fe96-106d-4ae8-90bc-184ae1249976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.052979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16fe96-106d-4ae8-90bc-184ae1249976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:34.059526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16fe96-106d-4ae8-90bc-184ae1249976 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:34.068339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fe1a29b0-fef6-45fc-994f-189aafbc07c9 None None] MFA Rules not processed for user `37f0281bb2d54880ac7bf2ede68050c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:34.070428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe1a29b0-fef6-45fc-994f-189aafbc07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:34.080752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 819/1641] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:34.082960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16fe96-106d-4ae8-90bc-184ae1249976 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:34.224980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16fe96-106d-4ae8-90bc-184ae1249976 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:34.232958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8544c3-c27f-4616-868f-0ffc51824dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:34.234607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8544c3-c27f-4616-868f-0ffc51824dc2 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.234607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8544c3-c27f-4616-868f-0ffc51824dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.234607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8544c3-c27f-4616-868f-0ffc51824dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.258719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 823/1642] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:34.260238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a29b0-fef6-45fc-994f-189aafbc07c9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:34.296549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a29b0-fef6-45fc-994f-189aafbc07c9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:34.299840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:34.310732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885171ca-9bda-4dd2-b5bf-ec93d2245cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:34.312300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885171ca-9bda-4dd2-b5bf-ec93d2245cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.312926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885171ca-9bda-4dd2-b5bf-ec93d2245cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.313595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885171ca-9bda-4dd2-b5bf-ec93d2245cd5 admin admin] PATH_INFO: `/v3/projects/991e6f7cdad842aaa3d1106573bfb0ad/users/dde73c37e6f6410aae7f68bf9c712ad9/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.314068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8544c3-c27f-4616-868f-0ffc51824dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:34.315952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8544c3-c27f-4616-868f-0ffc51824dc2 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:34.317020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885171ca-9bda-4dd2-b5bf-ec93d2245cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991e6f7cdad842aaa3d1106573bfb0ad, user_id=dde73c37e6f6410aae7f68bf9c712ad9, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:34.321118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885171ca-9bda-4dd2-b5bf-ec93d2245cd5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:34.330608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 820/1643] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:34.331687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8544c3-c27f-4616-868f-0ffc51824dc2 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:34.343669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8544c3-c27f-4616-868f-0ffc51824dc2 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:34.355527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b9e60-4511-431c-a2f9-3ceb755f2c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:34.357267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b9e60-4511-431c-a2f9-3ceb755f2c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.362629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b9e60-4511-431c-a2f9-3ceb755f2c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.362629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b9e60-4511-431c-a2f9-3ceb755f2c1d admin admin] PATH_INFO: `/v3/projects/23e107d5fca048a1957a4824043e43d6/users/ca2cfdb9ad714ef1a5ead186d63a9c6b/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.373225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 824/1644] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:34 2022] PUT /identity/v3/projects/991e6f7cdad842aaa3d1106573bfb0ad/users/dde73c37e6f6410aae7f68bf9c712ad9/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:34.373986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b9e60-4511-431c-a2f9-3ceb755f2c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e107d5fca048a1957a4824043e43d6, user_id=ca2cfdb9ad714ef1a5ead186d63a9c6b, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:34.374153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885171ca-9bda-4dd2-b5bf-ec93d2245cd5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:34.374482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b9e60-4511-431c-a2f9-3ceb755f2c1d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:34.434595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 821/1645] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:34 2022] PUT /identity/v3/projects/23e107d5fca048a1957a4824043e43d6/users/ca2cfdb9ad714ef1a5ead186d63a9c6b/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:34.436438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d78d1-7b05-4c2b-9018-3633d5638f20 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.436714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d78d1-7b05-4c2b-9018-3633d5638f20 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.436996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d78d1-7b05-4c2b-9018-3633d5638f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.494064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:34.509149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e63d78d1-7b05-4c2b-9018-3633d5638f20 None None] MFA Rules not processed for user `dde73c37e6f6410aae7f68bf9c712ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:34.510437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e63d78d1-7b05-4c2b-9018-3633d5638f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:34.560456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885171ca-9bda-4dd2-b5bf-ec93d2245cd5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:34.755772 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeb62e-d3e4-45f8-8e87-39e813a55971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:34.756753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeb62e-d3e4-45f8-8e87-39e813a55971 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.756891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeb62e-d3e4-45f8-8e87-39e813a55971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.757236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeb62e-d3e4-45f8-8e87-39e813a55971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.802354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 822/1646] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:34.804190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6face-d983-4dfa-85ee-e80741741b6e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.804476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6face-d983-4dfa-85ee-e80741741b6e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.805555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6face-d983-4dfa-85ee-e80741741b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.892251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-37b6face-d983-4dfa-85ee-e80741741b6e None None] MFA Rules not processed for user `ca2cfdb9ad714ef1a5ead186d63a9c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:34.901529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-37b6face-d983-4dfa-85ee-e80741741b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:34.932921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeb62e-d3e4-45f8-8e87-39e813a55971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:34.935959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeb62e-d3e4-45f8-8e87-39e813a55971 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:34.954687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 825/1647] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:34.956207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeb62e-d3e4-45f8-8e87-39e813a55971 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:34.971824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeb62e-d3e4-45f8-8e87-39e813a55971 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:34.983763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ed1ec-fc19-4c87-beb0-e5b75885e0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:34.984618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ed1ec-fc19-4c87-beb0-e5b75885e0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.985018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ed1ec-fc19-4c87-beb0-e5b75885e0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.985413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ed1ec-fc19-4c87-beb0-e5b75885e0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:35.023721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ed1ec-fc19-4c87-beb0-e5b75885e0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:35.028453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ed1ec-fc19-4c87-beb0-e5b75885e0a3 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:35.064088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 823/1648] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:35.064088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6face-d983-4dfa-85ee-e80741741b6e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:35.075682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 826/1649] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:35.171831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:35.196952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ed1ec-fc19-4c87-beb0-e5b75885e0a3 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:35.206778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6face-d983-4dfa-85ee-e80741741b6e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:35.217588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ed1ec-fc19-4c87-beb0-e5b75885e0a3 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:35.224798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:35.226884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:35.228527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:35.228921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] PATH_INFO: `/v3/users/4db0b3e2b8dd4a2d83316d1cb331598b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:35.230300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbeb065-69c6-4395-bb72-33c78a877b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:35.233746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb065-69c6-4395-bb72-33c78a877b81 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:35.235126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db0b3e2b8dd4a2d83316d1cb331598b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:35.235801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb065-69c6-4395-bb72-33c78a877b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:35.237043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbeb065-69c6-4395-bb72-33c78a877b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:35.242134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:35.272570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeb065-69c6-4395-bb72-33c78a877b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:35.279823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbeb065-69c6-4395-bb72-33c78a877b81 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:35.327002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 827/1650] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:35.369759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db0b3e2b8dd4a2d83316d1cb331598b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:35.407818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db0b3e2b8dd4a2d83316d1cb331598b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:35.409579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db0b3e2b8dd4a2d83316d1cb331598b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:35.448151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db0b3e2b8dd4a2d83316d1cb331598b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:35.452992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db0b3e2b8dd4a2d83316d1cb331598b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:35.488223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 824/1651] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:35 2022] DELETE /identity/v3/users/4db0b3e2b8dd4a2d83316d1cb331598b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:35.493718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3448-ba00-4c41-a6fc-94e9d7c3c06c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:35.494139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3448-ba00-4c41-a6fc-94e9d7c3c06c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:35.494541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be3448-ba00-4c41-a6fc-94e9d7c3c06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:35.557450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d9be3448-ba00-4c41-a6fc-94e9d7c3c06c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:35.559512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d9be3448-ba00-4c41-a6fc-94e9d7c3c06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:35.724607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:35.727589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:35.733205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 828/1652] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:35.761143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be3448-ba00-4c41-a6fc-94e9d7c3c06c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:35.762664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d9be3448-ba00-4c41-a6fc-94e9d7c3c06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:35.839867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:35.908666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1d6d-75d9-40d8-b02e-670b9525a5c9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:35.921218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34efe3-4f26-4fe1-a07c-a97eda7b5fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:35.922055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34efe3-4f26-4fe1-a07c-a97eda7b5fce service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:35.922384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34efe3-4f26-4fe1-a07c-a97eda7b5fce service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:35.922728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34efe3-4f26-4fe1-a07c-a97eda7b5fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:35.929089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bb34efe3-4f26-4fe1-a07c-a97eda7b5fce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:35.987412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be3448-ba00-4c41-a6fc-94e9d7c3c06c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:36.000924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:36.001897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:36.002955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:36.005692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:36.041619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:36.043792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:36.068824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 829/1653] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:28:36.100813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34efe3-4f26-4fe1-a07c-a97eda7b5fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:36.102302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34efe3-4f26-4fe1-a07c-a97eda7b5fce service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:36.125791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 825/1654] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:28:37.538462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:37.540354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:37.583378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fb907-96e4-49e3-ac48-0658791f87c8 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:37.605494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:37.628874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:37.634503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:37.634837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] PATH_INFO: `/v3/projects/eb4d02c8ce6f438985148f67a689331e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:37.640135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4d02c8ce6f438985148f67a689331e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:37.649834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:37.803778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4d02c8ce6f438985148f67a689331e', 'request_id': 'req-d01a17e4-f87a-46d6-8136-2652e8dd06aa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:37.821760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4d02c8ce6f438985148f67a689331e', 'request_id': 'req-d01a17e4-f87a-46d6-8136-2652e8dd06aa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:37.846908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4d02c8ce6f438985148f67a689331e', 'request_id': 'req-d01a17e4-f87a-46d6-8136-2652e8dd06aa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:37.900178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] The token cache is being invalidate because project eb4d02c8ce6f438985148f67a689331e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:28:37.902519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:37.904884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d01a17e4-f87a-46d6-8136-2652e8dd06aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:37.917814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 830/1655] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:28:37 2022] DELETE /identity/v3/projects/eb4d02c8ce6f438985148f67a689331e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:37.921742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21807cfd-b49c-4a0f-b7cc-698aff3d37ff None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:37.922413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21807cfd-b49c-4a0f-b7cc-698aff3d37ff None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:37.922667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21807cfd-b49c-4a0f-b7cc-698aff3d37ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.041875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-21807cfd-b49c-4a0f-b7cc-698aff3d37ff None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:38.046285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-21807cfd-b49c-4a0f-b7cc-698aff3d37ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.115530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:38.264806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 826/1656] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:38.277239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b21d-a68e-48d9-a8ae-8937e2c3330d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.278835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b21d-a68e-48d9-a8ae-8937e2c3330d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.279226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1b21d-a68e-48d9-a8ae-8937e2c3330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.295447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21807cfd-b49c-4a0f-b7cc-698aff3d37ff None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:38.296971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-21807cfd-b49c-4a0f-b7cc-698aff3d37ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.325648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21807cfd-b49c-4a0f-b7cc-698aff3d37ff None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:38.347241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a3e1b21d-a68e-48d9-a8ae-8937e2c3330d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:38.351121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:38.355229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.355846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.356516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] PATH_INFO: `/v3/users/ca34c50cd12e42a28c3cfe7c434e4113` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.359373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca34c50cd12e42a28c3cfe7c434e4113)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:38.361199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a3e1b21d-a68e-48d9-a8ae-8937e2c3330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.362365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:38.401480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 831/1657] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:38.402562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1b21d-a68e-48d9-a8ae-8937e2c3330d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:38.415971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1b21d-a68e-48d9-a8ae-8937e2c3330d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:38.429150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:38.430847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.431366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.431580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.433551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:38.433943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:38.436062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:38.462224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 832/1658] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:38.464795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:38.485729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b75522-615a-4478-9c97-099fd480ed76 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:38.494161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:38.500871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca34c50cd12e42a28c3cfe7c434e4113'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:38.503208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.503678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.504643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.507140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:38.510198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:38.537020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca34c50cd12e42a28c3cfe7c434e4113'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:38.539419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca34c50cd12e42a28c3cfe7c434e4113'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:38.560704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca34c50cd12e42a28c3cfe7c434e4113'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:38.561436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca34c50cd12e42a28c3cfe7c434e4113'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:38.579106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 833/1659] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:38 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:38.582104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 827/1660] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:38 2022] DELETE /identity/v3/users/ca34c50cd12e42a28c3cfe7c434e4113 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:38.583118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:38.584659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.586811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:38.593899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.692876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ddde-7506-4e7e-b475-ed9df39e613f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:38.699870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83867b-efde-4457-9c0f-dc705583fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:38.701109 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83867b-efde-4457-9c0f-dc705583fc30 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.701848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83867b-efde-4457-9c0f-dc705583fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.702559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83867b-efde-4457-9c0f-dc705583fc30 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.703704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83867b-efde-4457-9c0f-dc705583fc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:38.707268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83867b-efde-4457-9c0f-dc705583fc30 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:38.765347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 828/1661] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:38 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:38.770714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a390d-b0a4-42ad-a005-13eb11d3ffeb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.774109 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a390d-b0a4-42ad-a005-13eb11d3ffeb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.775136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a390d-b0a4-42ad-a005-13eb11d3ffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.789441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbed02-d7a8-421d-94c5-feaf027c3835 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:38.807164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:38.809171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.809616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.810037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] PATH_INFO: `/v3/users/00bded549c2d4dc88b5a4871eb155655` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.813763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00bded549c2d4dc88b5a4871eb155655)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:38.815110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: WARNING py.warnings [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:28:38.815110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: warnings.warn(msg) Jul 20 15:28:38.815110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: Jul 20 15:28:38.818690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-df3a390d-b0a4-42ad-a005-13eb11d3ffeb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:38.820407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-df3a390d-b0a4-42ad-a005-13eb11d3ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.820869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:38.834876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 829/1662] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:38.834876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a390d-b0a4-42ad-a005-13eb11d3ffeb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:38.846775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:38.864023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a390d-b0a4-42ad-a005-13eb11d3ffeb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:38.872861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:38.873963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.874358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.875556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.876605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:38.880639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:38.897257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 830/1663] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:38.899398 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:38.903934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.916818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:38.981862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00bded549c2d4dc88b5a4871eb155655'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:39.041981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00bded549c2d4dc88b5a4871eb155655'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:39.045596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00bded549c2d4dc88b5a4871eb155655'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:39.047427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00bded549c2d4dc88b5a4871eb155655'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:39.061257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376383f-de79-4b3e-be29-e4bc471b2291 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:39.067537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:39.068335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:39.068689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:39.069035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:39.071497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:39.083275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00bded549c2d4dc88b5a4871eb155655'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:39.116484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 834/1664] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:38 2022] DELETE /identity/v3/users/00bded549c2d4dc88b5a4871eb155655 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:39.116484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:39.116484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:39.238149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:39.239828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:39.277002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 831/1665] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:39.280457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:39.287826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:39.301107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01256da2-71d1-4cd2-b098-bf52bffeb8a7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:39.313075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:39.313819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:39.314107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:39.314439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:39.320643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:39.328682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2abd-99a7-4177-bb5d-2dee627b1a82 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:39.488011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b60c9-d3af-4592-8a67-fd28fff8cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:39.488947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b60c9-d3af-4592-8a67-fd28fff8cd7a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:39.489579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b60c9-d3af-4592-8a67-fd28fff8cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:39.490057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b60c9-d3af-4592-8a67-fd28fff8cd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:39.491047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b60c9-d3af-4592-8a67-fd28fff8cd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:39.494422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b60c9-d3af-4592-8a67-fd28fff8cd7a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:39.536108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 832/1666] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:39.539770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bfeea-e761-4511-b71e-9078acfeab54 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:39.544673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bfeea-e761-4511-b71e-9078acfeab54 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:39.549175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bfeea-e761-4511-b71e-9078acfeab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:39.602855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:39.604395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:39.624007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c22bfeea-e761-4511-b71e-9078acfeab54 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:39.625405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c22bfeea-e761-4511-b71e-9078acfeab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:39.649600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 835/1667] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:39.649764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 833/1668] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:39.649851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:39.679514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a209647-452b-47c8-bc7a-4cd1172b8ed6 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:39.695886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bfeea-e761-4511-b71e-9078acfeab54 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:39.700225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c22bfeea-e761-4511-b71e-9078acfeab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:39.700432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac59344-54c2-4f06-bf1b-bdd046c4abe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:39.701610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac59344-54c2-4f06-bf1b-bdd046c4abe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:39.701896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac59344-54c2-4f06-bf1b-bdd046c4abe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:39.702177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac59344-54c2-4f06-bf1b-bdd046c4abe2 admin admin] PATH_INFO: `/v3/projects/e5b46e7b30d9476082d95c8186a5ca41/users/434c3620919d4e4ca242bee3357fb8b3/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:39.727032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bfeea-e761-4511-b71e-9078acfeab54 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:39.740247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:39.741762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:39.742219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:39.742661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:39.764685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac59344-54c2-4f06-bf1b-bdd046c4abe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b46e7b30d9476082d95c8186a5ca41, user_id=434c3620919d4e4ca242bee3357fb8b3, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:39.769094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac59344-54c2-4f06-bf1b-bdd046c4abe2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:39.776253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:39.782945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:39.808603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 836/1669] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:39 2022] PUT /identity/v3/projects/e5b46e7b30d9476082d95c8186a5ca41/users/434c3620919d4e4ca242bee3357fb8b3/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:39.814745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab11c-2cbc-433d-8ce1-b579f534848e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:39.815274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab11c-2cbc-433d-8ce1-b579f534848e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:39.815576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fab11c-2cbc-433d-8ce1-b579f534848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:39.837468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 834/1670] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:39.843264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:39.850737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:39.889992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f8fab11c-2cbc-433d-8ce1-b579f534848e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:39.895112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb48d-dbae-4dec-be32-129912b498d5 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:39.896405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f8fab11c-2cbc-433d-8ce1-b579f534848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:39.909754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:39.980412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:40.060472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:40.061694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:40.062264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:40.062264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] PATH_INFO: `/v3/users/7e1520127f034619b03f909614251503` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:40.065132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1520127f034619b03f909614251503)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:40.067817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:40.111129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 837/1671] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:40.137166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fab11c-2cbc-433d-8ce1-b579f534848e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:40.183276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1520127f034619b03f909614251503'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:40.219915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1520127f034619b03f909614251503'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:40.220867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1520127f034619b03f909614251503'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:40.238905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1520127f034619b03f909614251503'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:40.244285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2978c65d-1bb6-4a3b-8d56-af5e6392401b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1520127f034619b03f909614251503'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:40.272545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 835/1672] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:39 2022] DELETE /identity/v3/users/7e1520127f034619b03f909614251503 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:40.281616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367ce9-6b73-4d2f-bbc9-c7a2ffa58a95 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:40.282513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367ce9-6b73-4d2f-bbc9-c7a2ffa58a95 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:40.283006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1367ce9-6b73-4d2f-bbc9-c7a2ffa58a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:40.324582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fab11c-2cbc-433d-8ce1-b579f534848e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:40.364970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c1367ce9-6b73-4d2f-bbc9-c7a2ffa58a95 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:40.369393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c1367ce9-6b73-4d2f-bbc9-c7a2ffa58a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:40.480726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:40.481974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:40.484759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:40.485107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:40.491590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:40.578796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 836/1673] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:40.632969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:40.634663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:40.646883 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 838/1674] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:28:40.704613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1367ce9-6b73-4d2f-bbc9-c7a2ffa58a95 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:40.706563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c1367ce9-6b73-4d2f-bbc9-c7a2ffa58a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:40.734215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1367ce9-6b73-4d2f-bbc9-c7a2ffa58a95 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:40.753385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d8dbd-7501-46d9-bfeb-14625ab3400b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:40.755255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d8dbd-7501-46d9-bfeb-14625ab3400b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:40.759634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d8dbd-7501-46d9-bfeb-14625ab3400b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:40.760223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d8dbd-7501-46d9-bfeb-14625ab3400b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:40.799389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d8dbd-7501-46d9-bfeb-14625ab3400b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:40.801157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d8dbd-7501-46d9-bfeb-14625ab3400b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:40.820679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 837/1675] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:41.778295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:41.785463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:41.809441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c724d30-a854-42ba-9574-63ba76e11765 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:41.848686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:41.849774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:41.850191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:41.851265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] PATH_INFO: `/v3/projects/e401f1926f5544c5ac7e5fc74a4cbfba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:41.855819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e401f1926f5544c5ac7e5fc74a4cbfba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:41.867947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:41.915850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:42.013285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e401f1926f5544c5ac7e5fc74a4cbfba', 'request_id': 'req-0a1b102e-1cb7-49f9-a000-ad991c68dc19'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.043126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e401f1926f5544c5ac7e5fc74a4cbfba', 'request_id': 'req-0a1b102e-1cb7-49f9-a000-ad991c68dc19'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.057015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e401f1926f5544c5ac7e5fc74a4cbfba', 'request_id': 'req-0a1b102e-1cb7-49f9-a000-ad991c68dc19'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.091015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] The token cache is being invalidate because project e401f1926f5544c5ac7e5fc74a4cbfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:28:42.092952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.094905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.101250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 839/1676] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:28:41 2022] DELETE /identity/v3/projects/e401f1926f5544c5ac7e5fc74a4cbfba => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:42.106783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ddea4-7fc5-40c7-9069-1bcda326219f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:42.107386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ddea4-7fc5-40c7-9069-1bcda326219f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:42.109363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ddea4-7fc5-40c7-9069-1bcda326219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:42.148179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-442ddea4-7fc5-40c7-9069-1bcda326219f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:42.152916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-442ddea4-7fc5-40c7-9069-1bcda326219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:42.262724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:42.307130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:42.308886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:42.389175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 838/1677] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:42.397126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbf5be-d4f2-4af3-8da8-a0bfa48188f8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:42.397421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbf5be-d4f2-4af3-8da8-a0bfa48188f8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:42.397945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbf5be-d4f2-4af3-8da8-a0bfa48188f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:42.459617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e5fbf5be-d4f2-4af3-8da8-a0bfa48188f8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:42.464471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e5fbf5be-d4f2-4af3-8da8-a0bfa48188f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:42.499024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 839/1678] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:42.501493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbf5be-d4f2-4af3-8da8-a0bfa48188f8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:42.529766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbf5be-d4f2-4af3-8da8-a0bfa48188f8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:42.561618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:42.562391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:42.562734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:42.563036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:42.566549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:42.569982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:42.580503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:42.595555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b102e-1cb7-49f9-a000-ad991c68dc19 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:42.617167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:42.618887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:42.620454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:42.621579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] PATH_INFO: `/v3/projects/7eb9db15010b4ff1aeaa1d7ce22f4fa1` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:42.622244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 840/1679] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:42.627862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb9db15010b4ff1aeaa1d7ce22f4fa1)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:42.628081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:42.633253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:42.655183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eceff80-e940-4ba8-a2d9-d110221db492 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:42.673026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2d2fd-5579-47d4-b6ae-47e273ec7685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:42.674194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2d2fd-5579-47d4-b6ae-47e273ec7685 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:42.674482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2d2fd-5579-47d4-b6ae-47e273ec7685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:42.674759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2d2fd-5579-47d4-b6ae-47e273ec7685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:42.680080 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2d2fd-5579-47d4-b6ae-47e273ec7685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:42.684298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2d2fd-5579-47d4-b6ae-47e273ec7685 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:42.764303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb9db15010b4ff1aeaa1d7ce22f4fa1', 'request_id': 'req-a860a25c-5daa-418b-98ba-7ff2edff5280'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.770781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 841/1680] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:42 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:28:42.775527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2d2fd-5579-47d4-b6ae-47e273ec7685 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:42.796069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb9db15010b4ff1aeaa1d7ce22f4fa1', 'request_id': 'req-a860a25c-5daa-418b-98ba-7ff2edff5280'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.807611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb9db15010b4ff1aeaa1d7ce22f4fa1', 'request_id': 'req-a860a25c-5daa-418b-98ba-7ff2edff5280'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.849398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] The token cache is being invalidate because project 7eb9db15010b4ff1aeaa1d7ce22f4fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:28:42.851482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.856604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:42.860188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 840/1681] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:28:42 2022] DELETE /identity/v3/projects/7eb9db15010b4ff1aeaa1d7ce22f4fa1 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:28:42.861407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:42.866087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:42.949135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:43.015599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2d2fd-5579-47d4-b6ae-47e273ec7685 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:43.036569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:43.040536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.040857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.041148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.044121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:43.052364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:43.056658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860a25c-5daa-418b-98ba-7ff2edff5280 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:43.094037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:43.095572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.096446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.104903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] PATH_INFO: `/v3/projects/0e14bbdad80e410d98afbdee360ea218` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.106369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 842/1682] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:42 2022] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:43.113626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:43.116527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e14bbdad80e410d98afbdee360ea218)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:43.119643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:43.134540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:43.171219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a867b-3400-480c-8125-31da3426a418 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:43.184926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:43.186792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.187274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.188117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] PATH_INFO: `/v3/users/ca2cfdb9ad714ef1a5ead186d63a9c6b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.223332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2cfdb9ad714ef1a5ead186d63a9c6b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:43.230206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:43.267250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e14bbdad80e410d98afbdee360ea218', 'request_id': 'req-d0399f28-7f74-44c4-b880-9155c0f72918'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.289881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e14bbdad80e410d98afbdee360ea218', 'request_id': 'req-d0399f28-7f74-44c4-b880-9155c0f72918'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.303465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e14bbdad80e410d98afbdee360ea218', 'request_id': 'req-d0399f28-7f74-44c4-b880-9155c0f72918'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.340190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] The token cache is being invalidate because project 0e14bbdad80e410d98afbdee360ea218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:28:43.340503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.344616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.352547 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 841/1683] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:28:42 2022] DELETE /identity/v3/projects/0e14bbdad80e410d98afbdee360ea218 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:43.353939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2cfdb9ad714ef1a5ead186d63a9c6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.354535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:43.358328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:43.386795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2cfdb9ad714ef1a5ead186d63a9c6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.387653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2cfdb9ad714ef1a5ead186d63a9c6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.407664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2cfdb9ad714ef1a5ead186d63a9c6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.409005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfaa252e-f798-47c3-9007-75648ab72593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2cfdb9ad714ef1a5ead186d63a9c6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:43.437610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:43.440191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 843/1684] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:43 2022] DELETE /identity/v3/users/ca2cfdb9ad714ef1a5ead186d63a9c6b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:43.442227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6452-eac8-406a-9a21-2ac0bee4b3a4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.452804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6452-eac8-406a-9a21-2ac0bee4b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.456170 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6452-eac8-406a-9a21-2ac0bee4b3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.530051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0e1c6452-eac8-406a-9a21-2ac0bee4b3a4 None None] MFA Rules not processed for user `4eca399e504a451e8925f13d3e156be3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:43.531314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0e1c6452-eac8-406a-9a21-2ac0bee4b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:43.569949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0399f28-7f74-44c4-b880-9155c0f72918 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:43.715123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 844/1685] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:43.719303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8336-4ceb-456c-8b52-11efc85cd3b4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.723920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8336-4ceb-456c-8b52-11efc85cd3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.724400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8336-4ceb-456c-8b52-11efc85cd3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.741931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:43.742692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.742994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.743286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.744041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:43.750412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:43.764838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-18eb8336-4ceb-456c-8b52-11efc85cd3b4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:43.768153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18eb8336-4ceb-456c-8b52-11efc85cd3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:43.785077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 842/1686] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:43.786151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:43.789602 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:43.795343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 845/1687] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:43.802287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:43.805490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb8336-4ceb-456c-8b52-11efc85cd3b4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:43.808406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18eb8336-4ceb-456c-8b52-11efc85cd3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:43.863649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb8336-4ceb-456c-8b52-11efc85cd3b4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:43.877106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2087b-2456-4b45-b230-675c70bd6465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:43.879115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2087b-2456-4b45-b230-675c70bd6465 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.879435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2087b-2456-4b45-b230-675c70bd6465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.880592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2087b-2456-4b45-b230-675c70bd6465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.883470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2087b-2456-4b45-b230-675c70bd6465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:43.887682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2087b-2456-4b45-b230-675c70bd6465 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:43.921349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 846/1688] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:43.922650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbb34-6a10-4bea-9d8b-1dfb6c654bf5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.922946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbb34-6a10-4bea-9d8b-1dfb6c654bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.923930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbb34-6a10-4bea-9d8b-1dfb6c654bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.981883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5f2dbb34-6a10-4bea-9d8b-1dfb6c654bf5 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:43.983219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5f2dbb34-6a10-4bea-9d8b-1dfb6c654bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:43.986251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64dfef-7f68-4685-9413-ffa7b1ef04f3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:43.992257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 847/1689] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:43.993248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d5740-4b76-4092-ab24-c388c6ac7afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:43.993531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c68c9-6bbb-4159-a143-62dde35762d3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.993825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c68c9-6bbb-4159-a143-62dde35762d3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.993925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5740-4b76-4092-ab24-c388c6ac7afb service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:43.994091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c68c9-6bbb-4159-a143-62dde35762d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:43.994179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5740-4b76-4092-ab24-c388c6ac7afb service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:43.994485 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5740-4b76-4092-ab24-c388c6ac7afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.008849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5740-4b76-4092-ab24-c388c6ac7afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:44.012253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5740-4b76-4092-ab24-c388c6ac7afb service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:44.027665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 843/1690] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:44.028902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d5740-4b76-4092-ab24-c388c6ac7afb service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:44.029047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ce7c68c9-6bbb-4159-a143-62dde35762d3 None None] MFA Rules not processed for user `8fea7edff657444ba5ae56a8657b0834`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:44.030858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ce7c68c9-6bbb-4159-a143-62dde35762d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:44.044636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d5740-4b76-4092-ab24-c388c6ac7afb service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:44.054211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:44.056913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:44.057368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:44.057792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] PATH_INFO: `/v3/projects/08e88c547a50466c8c8168eea0d411e5/users/7c3e0f41baa34912a04b65c6c08096f3/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.087823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e88c547a50466c8c8168eea0d411e5, user_id=7c3e0f41baa34912a04b65c6c08096f3, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:44.091544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:44.130734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 844/1691] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:44 2022] PUT /identity/v3/projects/08e88c547a50466c8c8168eea0d411e5/users/7c3e0f41baa34912a04b65c6c08096f3/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:44.130734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:44.130734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:44.180770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 848/1692] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:44.183121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd96e-56f9-412d-857b-c2239ee182fc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:44.183808 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd96e-56f9-412d-857b-c2239ee182fc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:44.184239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd96e-56f9-412d-857b-c2239ee182fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.219991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-eb9fd96e-56f9-412d-857b-c2239ee182fc None None] MFA Rules not processed for user `434c3620919d4e4ca242bee3357fb8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:44.221301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eb9fd96e-56f9-412d-857b-c2239ee182fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:44.276725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a2a43-da87-4a94-b292-31eba2eb8188 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:44.293262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:44.299361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:44.299745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:44.300285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] PATH_INFO: `/v3/projects/23e107d5fca048a1957a4824043e43d6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.303879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e107d5fca048a1957a4824043e43d6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:44.312632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:44.319356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:44.377725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 849/1693] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:44.383119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd96e-56f9-412d-857b-c2239ee182fc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:44.413273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd96e-56f9-412d-857b-c2239ee182fc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:44.442416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e107d5fca048a1957a4824043e43d6', 'request_id': 'req-671f5f04-6425-4ce5-bfac-67b3d5adf373'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:44.465124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e107d5fca048a1957a4824043e43d6', 'request_id': 'req-671f5f04-6425-4ce5-bfac-67b3d5adf373'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:44.492611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e107d5fca048a1957a4824043e43d6', 'request_id': 'req-671f5f04-6425-4ce5-bfac-67b3d5adf373'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:44.497048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:44.525091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] The token cache is being invalidate because project 23e107d5fca048a1957a4824043e43d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:28:44.525389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:44.529237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-671f5f04-6425-4ce5-bfac-67b3d5adf373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:44.536052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 845/1694] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:28:44 2022] DELETE /identity/v3/projects/23e107d5fca048a1957a4824043e43d6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:44.538026 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5e40-80a7-4939-b305-d621b4bb3dca None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:44.541849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5e40-80a7-4939-b305-d621b4bb3dca None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:44.541849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc5e40-80a7-4939-b305-d621b4bb3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.577753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9785ef2-c7ca-44c9-a589-cc0987a0ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:44.579304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785ef2-c7ca-44c9-a589-cc0987a0ccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:44.579601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785ef2-c7ca-44c9-a589-cc0987a0ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:44.579883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785ef2-c7ca-44c9-a589-cc0987a0ccd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.580689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9785ef2-c7ca-44c9-a589-cc0987a0ccd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:44.581191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9785ef2-c7ca-44c9-a589-cc0987a0ccd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:44.582835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9785ef2-c7ca-44c9-a589-cc0987a0ccd6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:44.609565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aebc5e40-80a7-4939-b305-d621b4bb3dca None None] MFA Rules not processed for user `7c3e0f41baa34912a04b65c6c08096f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:44.611591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aebc5e40-80a7-4939-b305-d621b4bb3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:44.619845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 850/1695] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:44.623781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247eaec-1168-4745-8543-5271e67bef05 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:44.624559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247eaec-1168-4745-8543-5271e67bef05 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:44.625102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247eaec-1168-4745-8543-5271e67bef05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.680466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7247eaec-1168-4745-8543-5271e67bef05 None None] MFA Rules not processed for user `8fea7edff657444ba5ae56a8657b0834`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:44.682640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7247eaec-1168-4745-8543-5271e67bef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:44.830658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 851/1696] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:44.832629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247eaec-1168-4745-8543-5271e67bef05 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:44.834213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 846/1697] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:44.838563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58fc3c-974b-4495-9844-58edddc38bbf None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:44.838563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58fc3c-974b-4495-9844-58edddc38bbf None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:44.838563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58fc3c-974b-4495-9844-58edddc38bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.839354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7247eaec-1168-4745-8543-5271e67bef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:44.860795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247eaec-1168-4745-8543-5271e67bef05 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:44.866795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:44.867747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:44.868184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:44.868614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:44.871753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:44.874530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:44.885337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7f58fc3c-974b-4495-9844-58edddc38bbf None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:44.886311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7f58fc3c-974b-4495-9844-58edddc38bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:44.897828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 847/1698] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:44.899203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58fc3c-974b-4495-9844-58edddc38bbf None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:44.907902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7f58fc3c-974b-4495-9844-58edddc38bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:44.930404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 852/1699] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:44 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:44.931463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:44.935595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58fc3c-974b-4495-9844-58edddc38bbf None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:44.936286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:45.078668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:45.101376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.102125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.102451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.102737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.103643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.105604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.117513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ca86-505f-45ba-a2fe-aadd2fb7e772 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:45.132035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1580d-3960-472a-92b2-b5e95bbb6df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.132719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1580d-3960-472a-92b2-b5e95bbb6df7 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.132994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1580d-3960-472a-92b2-b5e95bbb6df7 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.133441 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1580d-3960-472a-92b2-b5e95bbb6df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.135753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-41b1580d-3960-472a-92b2-b5e95bbb6df7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:45.190114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 848/1700] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:44 2022] POST /identity/v3/projects => generated 357 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:45.191549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.194644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:45.259278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1580d-3960-472a-92b2-b5e95bbb6df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.261963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1580d-3960-472a-92b2-b5e95bbb6df7 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.282798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 853/1701] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:45.284201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0e404-515f-46ec-a96d-dbe0da973597 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.284611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0e404-515f-46ec-a96d-dbe0da973597 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.284895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0e404-515f-46ec-a96d-dbe0da973597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.321706 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-82e0e404-515f-46ec-a96d-dbe0da973597 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:45.322950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-82e0e404-515f-46ec-a96d-dbe0da973597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:45.340160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c0d2a-d766-4495-922f-2b85cca83e27 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:45.350830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91073ea6-4757-44ce-93b7-255962cba9a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.351600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073ea6-4757-44ce-93b7-255962cba9a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.351884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073ea6-4757-44ce-93b7-255962cba9a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.352156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073ea6-4757-44ce-93b7-255962cba9a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.399777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:45.488664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 854/1702] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:45.493095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0e404-515f-46ec-a96d-dbe0da973597 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.526318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91073ea6-4757-44ce-93b7-255962cba9a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.535606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91073ea6-4757-44ce-93b7-255962cba9a6 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.541915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0e404-515f-46ec-a96d-dbe0da973597 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:45.568133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 849/1703] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:45.571641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad055-928b-4f72-87c7-b9701b90c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.572355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad055-928b-4f72-87c7-b9701b90c087 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.572644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad055-928b-4f72-87c7-b9701b90c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.572956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad055-928b-4f72-87c7-b9701b90c087 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.573629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aad055-928b-4f72-87c7-b9701b90c087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.580833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aad055-928b-4f72-87c7-b9701b90c087 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.583193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91073ea6-4757-44ce-93b7-255962cba9a6 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.634278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 855/1704] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:45 2022] POST /identity/v3/users => generated 309 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:45.635411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad055-928b-4f72-87c7-b9701b90c087 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.649984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad055-928b-4f72-87c7-b9701b90c087 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:45.655620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.656354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.656665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.656942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.658823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:45.659453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.661883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.673632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91073ea6-4757-44ce-93b7-255962cba9a6 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:45.686193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 856/1705] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:45.691580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad08d4-da9e-42d4-8bdb-b46a9461577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.692286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad08d4-da9e-42d4-8bdb-b46a9461577c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.692565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad08d4-da9e-42d4-8bdb-b46a9461577c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.693178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad08d4-da9e-42d4-8bdb-b46a9461577c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.693665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.693889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad08d4-da9e-42d4-8bdb-b46a9461577c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.705568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad08d4-da9e-42d4-8bdb-b46a9461577c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.716171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea375b8-16ef-4e54-8780-f80ffd34362c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:45.724233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d294e4-24ec-4afd-a943-0d0dd38e280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.725137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d294e4-24ec-4afd-a943-0d0dd38e280c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.725427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d294e4-24ec-4afd-a943-0d0dd38e280c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.725869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d294e4-24ec-4afd-a943-0d0dd38e280c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.726624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d294e4-24ec-4afd-a943-0d0dd38e280c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.728354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d294e4-24ec-4afd-a943-0d0dd38e280c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.750798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 857/1706] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:45.751719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d294e4-24ec-4afd-a943-0d0dd38e280c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.764672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 850/1707] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:45 2022] POST /identity/v3/users => generated 279 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:45.765717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad08d4-da9e-42d4-8bdb-b46a9461577c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.774950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d294e4-24ec-4afd-a943-0d0dd38e280c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:45.787101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b04259-16a5-48e6-88ab-a77cd3e6ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.789111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b04259-16a5-48e6-88ab-a77cd3e6ebd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.789111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b04259-16a5-48e6-88ab-a77cd3e6ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.789362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b04259-16a5-48e6-88ab-a77cd3e6ebd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.790349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b04259-16a5-48e6-88ab-a77cd3e6ebd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.794116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b04259-16a5-48e6-88ab-a77cd3e6ebd0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.801856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad08d4-da9e-42d4-8bdb-b46a9461577c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:45.813403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823ac96-9c7a-4c8b-aec8-c914b67d18a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:45.814485 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ac96-9c7a-4c8b-aec8-c914b67d18a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:45.814861 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ac96-9c7a-4c8b-aec8-c914b67d18a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:45.815262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ac96-9c7a-4c8b-aec8-c914b67d18a2 admin admin] PATH_INFO: `/v3/projects/518446872ad7487190d1ba0ce950fe96/users/c93a4711e1f8490988fd662062b677b4/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:45.854091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823ac96-9c7a-4c8b-aec8-c914b67d18a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518446872ad7487190d1ba0ce950fe96, user_id=c93a4711e1f8490988fd662062b677b4, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:45.859249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823ac96-9c7a-4c8b-aec8-c914b67d18a2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:45.891500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 858/1708] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:45 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:45.894172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b04259-16a5-48e6-88ab-a77cd3e6ebd0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.905108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 851/1709] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:45 2022] PUT /identity/v3/projects/518446872ad7487190d1ba0ce950fe96/users/c93a4711e1f8490988fd662062b677b4/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:45.910667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823ac96-9c7a-4c8b-aec8-c914b67d18a2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:45.990291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:46.039203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b04259-16a5-48e6-88ab-a77cd3e6ebd0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.124582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823ac96-9c7a-4c8b-aec8-c914b67d18a2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.143022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8688b-d6a1-487d-94c6-633a2334c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.146558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8688b-d6a1-487d-94c6-633a2334c484 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.147722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8688b-d6a1-487d-94c6-633a2334c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.147840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8688b-d6a1-487d-94c6-633a2334c484 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.151827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8688b-d6a1-487d-94c6-633a2334c484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:46.164059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8688b-d6a1-487d-94c6-633a2334c484 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:46.204190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8692-beef-4323-b3c6-a30c833394e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.219991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8692-beef-4323-b3c6-a30c833394e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.223469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8692-beef-4323-b3c6-a30c833394e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.230369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc8692-beef-4323-b3c6-a30c833394e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.237238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc8692-beef-4323-b3c6-a30c833394e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:46.239147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc8692-beef-4323-b3c6-a30c833394e5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:46.249458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 852/1710] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:45 2022] POST /identity/v3/users => generated 290 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:46.252714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8688b-d6a1-487d-94c6-633a2334c484 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:46.296112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 859/1711] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:46.300186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8692-beef-4323-b3c6-a30c833394e5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:46.310354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8688b-d6a1-487d-94c6-633a2334c484 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.332198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc8692-beef-4323-b3c6-a30c833394e5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.334152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58023f7-68b3-497f-9e8a-6866a1d9ba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.336117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58023f7-68b3-497f-9e8a-6866a1d9ba3a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.336409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58023f7-68b3-497f-9e8a-6866a1d9ba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.336692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58023f7-68b3-497f-9e8a-6866a1d9ba3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.344447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58023f7-68b3-497f-9e8a-6866a1d9ba3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:46.349842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58023f7-68b3-497f-9e8a-6866a1d9ba3a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:46.350820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9fbef-bc34-43fc-9a32-7fb60a3447c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.352334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9fbef-bc34-43fc-9a32-7fb60a3447c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.352829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9fbef-bc34-43fc-9a32-7fb60a3447c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.353301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9fbef-bc34-43fc-9a32-7fb60a3447c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.354260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9fbef-bc34-43fc-9a32-7fb60a3447c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:46.359652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9fbef-bc34-43fc-9a32-7fb60a3447c3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:46.390834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 860/1712] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:46.391537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9fbef-bc34-43fc-9a32-7fb60a3447c3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:46.416011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9fbef-bc34-43fc-9a32-7fb60a3447c3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.420353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 853/1713] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:46.421525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58023f7-68b3-497f-9e8a-6866a1d9ba3a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:46.446751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455d7fb-d340-47b2-8f07-bfd809f5407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.447560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455d7fb-d340-47b2-8f07-bfd809f5407e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.447761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455d7fb-d340-47b2-8f07-bfd809f5407e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.448097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455d7fb-d340-47b2-8f07-bfd809f5407e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.448760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455d7fb-d340-47b2-8f07-bfd809f5407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:46.463530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455d7fb-d340-47b2-8f07-bfd809f5407e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:46.478247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58023f7-68b3-497f-9e8a-6866a1d9ba3a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.517614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 861/1714] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:46.518503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455d7fb-d340-47b2-8f07-bfd809f5407e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:46.537617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca35ab8-74e3-4d9f-9222-e6b8aca703eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.541293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35ab8-74e3-4d9f-9222-e6b8aca703eb admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.541589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35ab8-74e3-4d9f-9222-e6b8aca703eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.541874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35ab8-74e3-4d9f-9222-e6b8aca703eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.549237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca35ab8-74e3-4d9f-9222-e6b8aca703eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:46.558469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca35ab8-74e3-4d9f-9222-e6b8aca703eb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:46.568596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455d7fb-d340-47b2-8f07-bfd809f5407e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.598181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e658b-33dd-4363-9c7e-5ed3380b1797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.599290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e658b-33dd-4363-9c7e-5ed3380b1797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.599452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e658b-33dd-4363-9c7e-5ed3380b1797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.599726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e658b-33dd-4363-9c7e-5ed3380b1797 admin admin] PATH_INFO: `/v3/projects/518446872ad7487190d1ba0ce950fe96/users/c93a4711e1f8490988fd662062b677b4/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.614724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e658b-33dd-4363-9c7e-5ed3380b1797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518446872ad7487190d1ba0ce950fe96, user_id=c93a4711e1f8490988fd662062b677b4, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:46.629258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e658b-33dd-4363-9c7e-5ed3380b1797 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:46.645136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 854/1715] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:46.647206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca35ab8-74e3-4d9f-9222-e6b8aca703eb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:46.674440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 862/1716] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:46 2022] PUT /identity/v3/projects/518446872ad7487190d1ba0ce950fe96/users/c93a4711e1f8490988fd662062b677b4/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:46.681559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e658b-33dd-4363-9c7e-5ed3380b1797 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:46.694385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca35ab8-74e3-4d9f-9222-e6b8aca703eb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.817552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:46.862443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b476e-bff5-4578-b8ec-258302a0dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.864407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b476e-bff5-4578-b8ec-258302a0dcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.865616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b476e-bff5-4578-b8ec-258302a0dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.867674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b476e-bff5-4578-b8ec-258302a0dcb8 admin admin] PATH_INFO: `/v3/projects/a4ffc305d1d04700b6acae5964c9f040/users/71278729f1804fbe96b2709d4023f238/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.919454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b476e-bff5-4578-b8ec-258302a0dcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ffc305d1d04700b6acae5964c9f040, user_id=71278729f1804fbe96b2709d4023f238, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:46.930689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b476e-bff5-4578-b8ec-258302a0dcb8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:46.941545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e658b-33dd-4363-9c7e-5ed3380b1797 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:46.955754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a1138-471f-4bdc-964d-1275a507187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:46.957969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a1138-471f-4bdc-964d-1275a507187e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.959206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a1138-471f-4bdc-964d-1275a507187e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.959991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a1138-471f-4bdc-964d-1275a507187e admin admin] PATH_INFO: `/v3/projects/b06e6c017afa4dda8e7f29ec953c87da/users/da8574aacf274b1f9759055845b10786/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.978559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 855/1717] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:46 2022] PUT /identity/v3/projects/a4ffc305d1d04700b6acae5964c9f040/users/71278729f1804fbe96b2709d4023f238/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:46.978559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cbe8-1374-40bb-938a-6d546097439e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.978559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cbe8-1374-40bb-938a-6d546097439e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.978559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cbe8-1374-40bb-938a-6d546097439e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:46.984164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 856/1718] 10.222.0.47 () {54 vars in 912 bytes} [Wed Jul 20 15:28:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:46.988985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786dd9a-0841-45d2-b3dc-c2f689e88242 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:46.989500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786dd9a-0841-45d2-b3dc-c2f689e88242 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:46.989860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786dd9a-0841-45d2-b3dc-c2f689e88242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:47.028120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a1138-471f-4bdc-964d-1275a507187e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06e6c017afa4dda8e7f29ec953c87da, user_id=da8574aacf274b1f9759055845b10786, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:47.043307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a1138-471f-4bdc-964d-1275a507187e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:47.069836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d786dd9a-0841-45d2-b3dc-c2f689e88242 None None] MFA Rules not processed for user `71278729f1804fbe96b2709d4023f238`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:47.074006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d786dd9a-0841-45d2-b3dc-c2f689e88242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:47.080965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 863/1719] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:46 2022] PUT /identity/v3/projects/b06e6c017afa4dda8e7f29ec953c87da/users/da8574aacf274b1f9759055845b10786/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:47.083543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0648-a3d2-47fe-9c49-69ec946284d4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:47.083858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0648-a3d2-47fe-9c49-69ec946284d4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:47.084161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0648-a3d2-47fe-9c49-69ec946284d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:47.150132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-451d0648-a3d2-47fe-9c49-69ec946284d4 None None] MFA Rules not processed for user `3894e1d2983e4040a4b0ae92ce794f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:47.151825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-451d0648-a3d2-47fe-9c49-69ec946284d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:47.174897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:47.252761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 857/1720] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:47.254429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ae9c-c5b7-4eb9-8541-1cc72af6d016 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:47.254865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ae9c-c5b7-4eb9-8541-1cc72af6d016 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:47.255410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ae9c-c5b7-4eb9-8541-1cc72af6d016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:47.310379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 864/1721] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:47.314929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0648-a3d2-47fe-9c49-69ec946284d4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:47.348813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-26c0ae9c-c5b7-4eb9-8541-1cc72af6d016 None None] MFA Rules not processed for user `da8574aacf274b1f9759055845b10786`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:47.350167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-26c0ae9c-c5b7-4eb9-8541-1cc72af6d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:47.528194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 858/1722] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:47.534952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0ae9c-c5b7-4eb9-8541-1cc72af6d016 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:47.584223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0648-a3d2-47fe-9c49-69ec946284d4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:47.598078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:47.598792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:47.599098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:47.599372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:47.600108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:47.602099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:47.675318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:47.731879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 865/1723] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:47 2022] POST /identity/v3/projects => generated 355 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:47.741089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:47.741947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0ae9c-c5b7-4eb9-8541-1cc72af6d016 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:47.754844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:47.956641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c5a5b-7f28-4539-8460-0bc2b3c2d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:47.959904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5a5b-7f28-4539-8460-0bc2b3c2d856 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:47.960666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5a5b-7f28-4539-8460-0bc2b3c2d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:47.960955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5a5b-7f28-4539-8460-0bc2b3c2d856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:47.963420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c5a5b-7f28-4539-8460-0bc2b3c2d856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:47.965142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393608b-a13e-4b05-be8c-068cd0ddf900 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:47.967589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c5a5b-7f28-4539-8460-0bc2b3c2d856 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:47.977308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eeee79-a4b6-4d8a-84bb-cc91bc906f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:47.982303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeee79-a4b6-4d8a-84bb-cc91bc906f91 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:47.982845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeee79-a4b6-4d8a-84bb-cc91bc906f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:47.984255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeee79-a4b6-4d8a-84bb-cc91bc906f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.014585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eeee79-a4b6-4d8a-84bb-cc91bc906f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.018419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eeee79-a4b6-4d8a-84bb-cc91bc906f91 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.051526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 859/1724] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:47 2022] POST /identity/v3/projects => generated 379 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:48.052504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c5a5b-7f28-4539-8460-0bc2b3c2d856 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:48.059877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 866/1725] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:48.067183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eeee79-a4b6-4d8a-84bb-cc91bc906f91 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:48.104415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eeee79-a4b6-4d8a-84bb-cc91bc906f91 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:48.273675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c5a5b-7f28-4539-8460-0bc2b3c2d856 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:48.290103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0bb01-3b0a-4c6f-b7f9-dabf151a7a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:48.291452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bb01-3b0a-4c6f-b7f9-dabf151a7a04 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.291805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bb01-3b0a-4c6f-b7f9-dabf151a7a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.292146 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bb01-3b0a-4c6f-b7f9-dabf151a7a04 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.295604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0bb01-3b0a-4c6f-b7f9-dabf151a7a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.301650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0bb01-3b0a-4c6f-b7f9-dabf151a7a04 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.325335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:48.359195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 860/1726] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:48 2022] POST /identity/v3/users => generated 284 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:48.365238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0bb01-3b0a-4c6f-b7f9-dabf151a7a04 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:48.369635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe03ef-2b7b-475b-b922-b76b389aa088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:48.378238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe03ef-2b7b-475b-b922-b76b389aa088 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.378825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe03ef-2b7b-475b-b922-b76b389aa088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.379469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe03ef-2b7b-475b-b922-b76b389aa088 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.383817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe03ef-2b7b-475b-b922-b76b389aa088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.393359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0bb01-3b0a-4c6f-b7f9-dabf151a7a04 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:48.398442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe03ef-2b7b-475b-b922-b76b389aa088 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.399888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa8516-fc2a-4b7a-bb53-f74f14b60d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:48.400760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa8516-fc2a-4b7a-bb53-f74f14b60d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.401048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa8516-fc2a-4b7a-bb53-f74f14b60d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.401376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa8516-fc2a-4b7a-bb53-f74f14b60d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.402333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa8516-fc2a-4b7a-bb53-f74f14b60d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.404303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa8516-fc2a-4b7a-bb53-f74f14b60d34 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.432467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 861/1727] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:48.435695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa8516-fc2a-4b7a-bb53-f74f14b60d34 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:48.473112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 867/1728] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:48 2022] POST /identity/v3/users => generated 296 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:48.488456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe03ef-2b7b-475b-b922-b76b389aa088 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:48.504239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe03ef-2b7b-475b-b922-b76b389aa088 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:48.505382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa8516-fc2a-4b7a-bb53-f74f14b60d34 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:48.521443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970165a-14b3-42a0-b6c3-85ce32f89acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:48.522190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970165a-14b3-42a0-b6c3-85ce32f89acb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.522570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970165a-14b3-42a0-b6c3-85ce32f89acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.523232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970165a-14b3-42a0-b6c3-85ce32f89acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.525543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970165a-14b3-42a0-b6c3-85ce32f89acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.527996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970165a-14b3-42a0-b6c3-85ce32f89acb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.536546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc3602-53ba-44c6-a86e-f213056f2da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:48.538022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3602-53ba-44c6-a86e-f213056f2da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.551290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3602-53ba-44c6-a86e-f213056f2da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.551726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3602-53ba-44c6-a86e-f213056f2da8 admin admin] PATH_INFO: `/v3/projects/bd4de713a54f487cbfe023dabec47948/users/1d1686bf559a4e279c05bc2f5666e178/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.558165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 868/1729] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:48.561502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970165a-14b3-42a0-b6c3-85ce32f89acb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:48.587057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970165a-14b3-42a0-b6c3-85ce32f89acb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:48.607844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742f17e-c324-4897-8d8e-6b7421a4daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:48.608780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742f17e-c324-4897-8d8e-6b7421a4daff admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.609063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742f17e-c324-4897-8d8e-6b7421a4daff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.609340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742f17e-c324-4897-8d8e-6b7421a4daff admin admin] PATH_INFO: `/v3/projects/82b50bb83ad04b6a8514057ab57c6820/users/cf4c4de85dd7462a8f327a66e560a2bb/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.628793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc3602-53ba-44c6-a86e-f213056f2da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4de713a54f487cbfe023dabec47948, user_id=1d1686bf559a4e279c05bc2f5666e178, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.636660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc3602-53ba-44c6-a86e-f213056f2da8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.668063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742f17e-c324-4897-8d8e-6b7421a4daff admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b50bb83ad04b6a8514057ab57c6820, user_id=cf4c4de85dd7462a8f327a66e560a2bb, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.678698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742f17e-c324-4897-8d8e-6b7421a4daff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.687452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 862/1730] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:48 2022] PUT /identity/v3/projects/bd4de713a54f487cbfe023dabec47948/users/1d1686bf559a4e279c05bc2f5666e178/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:48.689185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc3602-53ba-44c6-a86e-f213056f2da8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:48.709827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 869/1731] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:48 2022] PUT /identity/v3/projects/82b50bb83ad04b6a8514057ab57c6820/users/cf4c4de85dd7462a8f327a66e560a2bb/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:48.712802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742f17e-c324-4897-8d8e-6b7421a4daff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:48.815053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:48.893481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc3602-53ba-44c6-a86e-f213056f2da8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:48.912248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd0707-d3da-4394-afc4-e69763b7bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:48.913101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0707-d3da-4394-afc4-e69763b7bc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.913415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0707-d3da-4394-afc4-e69763b7bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.913777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0707-d3da-4394-afc4-e69763b7bc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.914566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0707-d3da-4394-afc4-e69763b7bc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.916624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742f17e-c324-4897-8d8e-6b7421a4daff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:48.924489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd0707-d3da-4394-afc4-e69763b7bc91 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.941526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83e871-2861-4e1f-9668-782bbfda4e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:48.944945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e871-2861-4e1f-9668-782bbfda4e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.945252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e871-2861-4e1f-9668-782bbfda4e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.945505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e871-2861-4e1f-9668-782bbfda4e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.946464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83e871-2861-4e1f-9668-782bbfda4e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:48.948184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83e871-2861-4e1f-9668-782bbfda4e34 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:48.957362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 863/1732] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:28:48.966081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8de9-0d4c-4300-bbd8-57fd93e68d20 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:48.967627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8de9-0d4c-4300-bbd8-57fd93e68d20 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:48.967931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf8de9-0d4c-4300-bbd8-57fd93e68d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:48.983234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 870/1733] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:48.990306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83e871-2861-4e1f-9668-782bbfda4e34 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:49.007240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4aaf8de9-0d4c-4300-bbd8-57fd93e68d20 None None] MFA Rules not processed for user `4eca399e504a451e8925f13d3e156be3`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:49.017009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83e871-2861-4e1f-9668-782bbfda4e34 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:49.018741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4aaf8de9-0d4c-4300-bbd8-57fd93e68d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:49.025545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66e3cc-bb68-40f3-9f55-e23888e74e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:49.027996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66e3cc-bb68-40f3-9f55-e23888e74e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:49.028212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66e3cc-bb68-40f3-9f55-e23888e74e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:49.028651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66e3cc-bb68-40f3-9f55-e23888e74e58 admin admin] PATH_INFO: `/v3/projects/bd4de713a54f487cbfe023dabec47948/users/1d1686bf559a4e279c05bc2f5666e178/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:49.032696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66e3cc-bb68-40f3-9f55-e23888e74e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4de713a54f487cbfe023dabec47948, user_id=1d1686bf559a4e279c05bc2f5666e178, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:49.040807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66e3cc-bb68-40f3-9f55-e23888e74e58 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:49.070694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 871/1734] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:48 2022] PUT /identity/v3/projects/bd4de713a54f487cbfe023dabec47948/users/1d1686bf559a4e279c05bc2f5666e178/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:49.072106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66e3cc-bb68-40f3-9f55-e23888e74e58 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:49.140243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 864/1735] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:49.140243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4d057-0ca1-4b25-a676-9dd4ade83088 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:49.140243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4d057-0ca1-4b25-a676-9dd4ade83088 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:49.140243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4d057-0ca1-4b25-a676-9dd4ade83088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:49.261103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-acb4d057-0ca1-4b25-a676-9dd4ade83088 None None] MFA Rules not processed for user `1d1686bf559a4e279c05bc2f5666e178`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:49.266604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-acb4d057-0ca1-4b25-a676-9dd4ade83088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:49.308389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66e3cc-bb68-40f3-9f55-e23888e74e58 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:49.330921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3431d8-19f5-43af-911f-7e97663555b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:49.332549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3431d8-19f5-43af-911f-7e97663555b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:49.335925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3431d8-19f5-43af-911f-7e97663555b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:49.336450 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3431d8-19f5-43af-911f-7e97663555b0 admin admin] PATH_INFO: `/v3/projects/82b50bb83ad04b6a8514057ab57c6820/users/cf4c4de85dd7462a8f327a66e560a2bb/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:49.342740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3431d8-19f5-43af-911f-7e97663555b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b50bb83ad04b6a8514057ab57c6820, user_id=cf4c4de85dd7462a8f327a66e560a2bb, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:49.345752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3431d8-19f5-43af-911f-7e97663555b0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:49.366527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 872/1736] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:49 2022] PUT /identity/v3/projects/82b50bb83ad04b6a8514057ab57c6820/users/cf4c4de85dd7462a8f327a66e560a2bb/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:49.385592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3205f43-f097-443f-b823-69fa593ed682 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:49.385890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3205f43-f097-443f-b823-69fa593ed682 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:49.386225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3205f43-f097-443f-b823-69fa593ed682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:49.432247 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c3205f43-f097-443f-b823-69fa593ed682 None None] MFA Rules not processed for user `cf4c4de85dd7462a8f327a66e560a2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:49.433492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c3205f43-f097-443f-b823-69fa593ed682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:49.453536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 865/1737] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:49.453536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23c564-7bbc-4334-a1f5-6c4d5a4e51c6 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:49.453536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23c564-7bbc-4334-a1f5-6c4d5a4e51c6 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:49.453536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23c564-7bbc-4334-a1f5-6c4d5a4e51c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:49.478929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:49.492855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2d23c564-7bbc-4334-a1f5-6c4d5a4e51c6 None None] MFA Rules not processed for user `c93a4711e1f8490988fd662062b677b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:49.494401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2d23c564-7bbc-4334-a1f5-6c4d5a4e51c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:49.566887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:49.628192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 866/1738] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:49.630235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23c564-7bbc-4334-a1f5-6c4d5a4e51c6 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:49.645938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 873/1739] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:49.661325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3205f43-f097-443f-b823-69fa593ed682 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:49.662781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c3205f43-f097-443f-b823-69fa593ed682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:49.820504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3205f43-f097-443f-b823-69fa593ed682 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:49.837173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9815941-91da-42f4-9c36-f683ee4266ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:49.838375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9815941-91da-42f4-9c36-f683ee4266ae service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:49.838623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9815941-91da-42f4-9c36-f683ee4266ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:49.839190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9815941-91da-42f4-9c36-f683ee4266ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:49.843700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23c564-7bbc-4334-a1f5-6c4d5a4e51c6 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:49.849797 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6d5cb-8b25-4325-aa06-f045d9610bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:49.850513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6d5cb-8b25-4325-aa06-f045d9610bfe service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:49.850925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6d5cb-8b25-4325-aa06-f045d9610bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:49.851240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6d5cb-8b25-4325-aa06-f045d9610bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:49.963570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9815941-91da-42f4-9c36-f683ee4266ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:49.967590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9815941-91da-42f4-9c36-f683ee4266ae service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:49.992077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 874/1740] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:28:49.998323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6d5cb-8b25-4325-aa06-f045d9610bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:50.000682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6d5cb-8b25-4325-aa06-f045d9610bfe service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:50.013063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0bb0-8651-4cf1-bede-67f671369df1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:50.013545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0bb0-8651-4cf1-bede-67f671369df1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:50.014102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0bb0-8651-4cf1-bede-67f671369df1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:50.017223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 867/1741] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:50.019423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 875/1742] 10.222.0.47 () {54 vars in 961 bytes} [Wed Jul 20 15:28:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:50.028507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55124cee-2af9-45f5-985e-fc0483a86463 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:50.029600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55124cee-2af9-45f5-985e-fc0483a86463 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:50.029600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55124cee-2af9-45f5-985e-fc0483a86463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:50.061410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-55124cee-2af9-45f5-985e-fc0483a86463 None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:50.063637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-55124cee-2af9-45f5-985e-fc0483a86463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:50.079871 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811953d-5dff-4f89-86a4-b496e3a83f09 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:50.080161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811953d-5dff-4f89-86a4-b496e3a83f09 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:50.080439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811953d-5dff-4f89-86a4-b496e3a83f09 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:50.082068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 876/1743] 10.222.0.47 () {54 vars in 912 bytes} [Wed Jul 20 15:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:28:50.106752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7c6a-af89-4952-b02d-76deaad0c787 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:50.107052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7c6a-af89-4952-b02d-76deaad0c787 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:50.107330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7c6a-af89-4952-b02d-76deaad0c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:50.150493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c3fc7c6a-af89-4952-b02d-76deaad0c787 None None] MFA Rules not processed for user `3894e1d2983e4040a4b0ae92ce794f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:50.163478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c3fc7c6a-af89-4952-b02d-76deaad0c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:50.225578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 868/1744] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Jul 20 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:50.234289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55124cee-2af9-45f5-985e-fc0483a86463 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:50.262223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55124cee-2af9-45f5-985e-fc0483a86463 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:50.295732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:50.296425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:50.296744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:50.296976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:50.300466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:50.312959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 877/1745] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:28:50.335352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7c6a-af89-4952-b02d-76deaad0c787 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:50.346684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7c6a-af89-4952-b02d-76deaad0c787 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:50.354555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:50.356301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:50.359417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b091e1-0ea5-4f00-9393-d56f1ff75c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:50.361591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b091e1-0ea5-4f00-9393-d56f1ff75c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:50.366563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b091e1-0ea5-4f00-9393-d56f1ff75c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:50.369084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b091e1-0ea5-4f00-9393-d56f1ff75c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:50.394614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 869/1746] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:50.406648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b091e1-0ea5-4f00-9393-d56f1ff75c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:50.408162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b091e1-0ea5-4f00-9393-d56f1ff75c1b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:50.420627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:50.438178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 878/1747] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:28:50.759660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:50.774675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa4ac-5b9a-4537-a7e7-c889ef1ddcef service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:50.783785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967382-9c9e-4d76-b3cd-c6eb564ed686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:50.787468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967382-9c9e-4d76-b3cd-c6eb564ed686 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:50.789822 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967382-9c9e-4d76-b3cd-c6eb564ed686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:50.791226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967382-9c9e-4d76-b3cd-c6eb564ed686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:50.836503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:51.026308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31967382-9c9e-4d76-b3cd-c6eb564ed686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:51.027919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31967382-9c9e-4d76-b3cd-c6eb564ed686 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:51.067844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 870/1748] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:28:51.626051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b091e1-0ea5-4f00-9393-d56f1ff75c1b service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:51.647392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b091e1-0ea5-4f00-9393-d56f1ff75c1b service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:51.656550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c969-aeb1-4398-b8f7-26dd3ff95cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:51.657224 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c969-aeb1-4398-b8f7-26dd3ff95cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:51.657777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c969-aeb1-4398-b8f7-26dd3ff95cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:51.658076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c969-aeb1-4398-b8f7-26dd3ff95cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:51.671922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84c969-aeb1-4398-b8f7-26dd3ff95cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:51.673437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84c969-aeb1-4398-b8f7-26dd3ff95cd4 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:51.712046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 879/1749] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:51.919791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16cfe8-7630-4958-93e8-7e4df7aa6341 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:51.919791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16cfe8-7630-4958-93e8-7e4df7aa6341 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:51.919791 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16cfe8-7630-4958-93e8-7e4df7aa6341 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:51.926948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 871/1750] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:28:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:51.967293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac727-fdda-4fdb-adc4-3e68bac598b7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:51.967747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac727-fdda-4fdb-adc4-3e68bac598b7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:51.968461 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac727-fdda-4fdb-adc4-3e68bac598b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:52.031620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dd4ac727-fdda-4fdb-adc4-3e68bac598b7 None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:52.034178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd4ac727-fdda-4fdb-adc4-3e68bac598b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:52.048491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 880/1751] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:52.076322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16cfe8-7630-4958-93e8-7e4df7aa6341 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:52.124961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16cfe8-7630-4958-93e8-7e4df7aa6341 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:52.134018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcd003-ec15-4b71-b6f2-b41df5821476 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:52.135144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcd003-ec15-4b71-b6f2-b41df5821476 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:52.136273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcd003-ec15-4b71-b6f2-b41df5821476 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:52.136837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcd003-ec15-4b71-b6f2-b41df5821476 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:52.154738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcd003-ec15-4b71-b6f2-b41df5821476 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:52.157728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcd003-ec15-4b71-b6f2-b41df5821476 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:52.209335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 872/1752] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:53.664586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ac727-fdda-4fdb-adc4-3e68bac598b7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:53.704449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebed011-55c2-4446-b303-230fbdc45d13 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:53.704969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebed011-55c2-4446-b303-230fbdc45d13 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:53.705309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebed011-55c2-4446-b303-230fbdc45d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:53.793917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3ebed011-55c2-4446-b303-230fbdc45d13 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:53.796786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ebed011-55c2-4446-b303-230fbdc45d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:53.879814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ac727-fdda-4fdb-adc4-3e68bac598b7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:53.897488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:53.900296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:53.900769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:53.902410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] PATH_INFO: `/v3/users/434c3620919d4e4ca242bee3357fb8b3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:53.906134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=434c3620919d4e4ca242bee3357fb8b3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:53.908726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:54.018705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 873/1753] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:54.051622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434c3620919d4e4ca242bee3357fb8b3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:54.079198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434c3620919d4e4ca242bee3357fb8b3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:54.080811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434c3620919d4e4ca242bee3357fb8b3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:54.093245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434c3620919d4e4ca242bee3357fb8b3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:54.094618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434c3620919d4e4ca242bee3357fb8b3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:54.118360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 881/1754] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:53 2022] DELETE /identity/v3/users/434c3620919d4e4ca242bee3357fb8b3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:54.294044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebed011-55c2-4446-b303-230fbdc45d13 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:54.295875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ebed011-55c2-4446-b303-230fbdc45d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:54.511994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:54.563302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:54.566226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:54.583743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebed011-55c2-4446-b303-230fbdc45d13 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:54.798549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:54.810977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5836a-4c3b-4378-8b3a-51d749b0d08d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:54.825059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:54.826319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:54.827275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:54.828358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:54.828887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:54.829305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:54.830689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:54.831140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] PATH_INFO: `/v3/projects/e5b46e7b30d9476082d95c8186a5ca41` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:54.841893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b46e7b30d9476082d95c8186a5ca41)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:54.841893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: WARNING py.warnings [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:28:54.841893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: warnings.warn(msg) Jul 20 15:28:54.841893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: Jul 20 15:28:54.841893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:54.842215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:55.034576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b46e7b30d9476082d95c8186a5ca41', 'request_id': 'req-4c93065f-9eda-4af1-bac4-073e82d6b0ba'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.042081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:55.046065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:55.053885 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b46e7b30d9476082d95c8186a5ca41', 'request_id': 'req-4c93065f-9eda-4af1-bac4-073e82d6b0ba'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.073081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b46e7b30d9476082d95c8186a5ca41', 'request_id': 'req-4c93065f-9eda-4af1-bac4-073e82d6b0ba'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.102527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 874/1755] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:28:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:28:55.159787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] The token cache is being invalidate because project e5b46e7b30d9476082d95c8186a5ca41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:28:55.160744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.164347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.170791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 882/1756] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:28:54 2022] DELETE /identity/v3/projects/e5b46e7b30d9476082d95c8186a5ca41 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:55.175324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:55.234225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836ed64-e446-4671-984d-767de685b0d7 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:55.466034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:55.468048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:55.470153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:55.470562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] PATH_INFO: `/v3/users/c93a4711e1f8490988fd662062b677b4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:55.474383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93a4711e1f8490988fd662062b677b4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:55.478414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:55.580532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:55.601814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93a4711e1f8490988fd662062b677b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.630776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93a4711e1f8490988fd662062b677b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.631805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93a4711e1f8490988fd662062b677b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.632658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93a4711e1f8490988fd662062b677b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.657975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-dbb3ef51-c427-4711-9223-ff0e6bc755a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93a4711e1f8490988fd662062b677b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:55.690505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 875/1757] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:55 2022] DELETE /identity/v3/users/c93a4711e1f8490988fd662062b677b4 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:56.252960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:56.255266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:56.280346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93065f-9eda-4af1-bac4-073e82d6b0ba admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:56.370522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:56.373796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:56.374089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:56.374379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] PATH_INFO: `/v3/projects/518446872ad7487190d1ba0ce950fe96` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:56.377827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=518446872ad7487190d1ba0ce950fe96)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:56.379977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:56.538080 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518446872ad7487190d1ba0ce950fe96', 'request_id': 'req-fa6edd4c-097c-4105-a05d-b5046f238b78'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:56.563364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518446872ad7487190d1ba0ce950fe96', 'request_id': 'req-fa6edd4c-097c-4105-a05d-b5046f238b78'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:56.594223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518446872ad7487190d1ba0ce950fe96', 'request_id': 'req-fa6edd4c-097c-4105-a05d-b5046f238b78'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:56.633090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] The token cache is being invalidate because project 518446872ad7487190d1ba0ce950fe96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:28:56.634629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:56.636256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fa6edd4c-097c-4105-a05d-b5046f238b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:56.647555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 883/1758] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:28:56 2022] DELETE /identity/v3/projects/518446872ad7487190d1ba0ce950fe96 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:56.656055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf26c-dcee-4f80-91e2-d81c3117246f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:56.657515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf26c-dcee-4f80-91e2-d81c3117246f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:56.658344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf26c-dcee-4f80-91e2-d81c3117246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:56.692738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-997bf26c-dcee-4f80-91e2-d81c3117246f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:56.695162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-997bf26c-dcee-4f80-91e2-d81c3117246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:56.763665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d679-0397-4832-9160-33eb94f797e0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:56.764208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d679-0397-4832-9160-33eb94f797e0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:56.764738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d679-0397-4832-9160-33eb94f797e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:56.838106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 876/1759] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:56.848139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-49f1d679-0397-4832-9160-33eb94f797e0 None None] MFA Rules not processed for user `3894e1d2983e4040a4b0ae92ce794f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:56.850580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49f1d679-0397-4832-9160-33eb94f797e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:56.854491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae639d7-7679-4210-89c9-9a864d6f223a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:56.855448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae639d7-7679-4210-89c9-9a864d6f223a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:56.856054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae639d7-7679-4210-89c9-9a864d6f223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:56.931244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:56.967925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0ae639d7-7679-4210-89c9-9a864d6f223a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:56.973853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0ae639d7-7679-4210-89c9-9a864d6f223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:57.021779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 877/1761] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:28:57.022417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 884/1761] 10.222.0.98 () {58 vars in 1015 bytes} [Wed Jul 20 15:28:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:57.023477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae639d7-7679-4210-89c9-9a864d6f223a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:57.072053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1d679-0397-4832-9160-33eb94f797e0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:57.079916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49f1d679-0397-4832-9160-33eb94f797e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:57.087834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae639d7-7679-4210-89c9-9a864d6f223a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:57.114015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:57.115227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.115721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.116205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.116676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1d679-0397-4832-9160-33eb94f797e0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:57.118292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:28:57.118292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:57.120999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:57.123553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ed968-efc3-44cc-92a6-e9bd83a25b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:57.124891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ed968-efc3-44cc-92a6-e9bd83a25b71 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.125456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ed968-efc3-44cc-92a6-e9bd83a25b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.126072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ed968-efc3-44cc-92a6-e9bd83a25b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.164762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ed968-efc3-44cc-92a6-e9bd83a25b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:57.170758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ed968-efc3-44cc-92a6-e9bd83a25b71 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:57.187551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 885/1762] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:28:57.204711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ed968-efc3-44cc-92a6-e9bd83a25b71 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:57.211280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 878/1763] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:57.225210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ed968-efc3-44cc-92a6-e9bd83a25b71 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:57.234162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:57.235337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.235815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.236421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.237608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:57.239904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:57.322736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 886/1764] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:57 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:28:57.324442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:57.345647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e18a6-f5d4-4a1f-9f6d-bf68b6a75d89 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:57.401996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:57.403802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:57.510615 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226834-11f1-4abc-9438-105ae01421a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:57.511840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226834-11f1-4abc-9438-105ae01421a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.512575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226834-11f1-4abc-9438-105ae01421a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.513343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226834-11f1-4abc-9438-105ae01421a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.514417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11226834-11f1-4abc-9438-105ae01421a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:57.521303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11226834-11f1-4abc-9438-105ae01421a0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:57.580087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 879/1765] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:57 2022] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:28:57.583609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226834-11f1-4abc-9438-105ae01421a0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:57.613116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226834-11f1-4abc-9438-105ae01421a0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:57.627525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2cdf-0e9b-4094-9cff-28f9f829b13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:57.632827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2cdf-0e9b-4094-9cff-28f9f829b13f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.633382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2cdf-0e9b-4094-9cff-28f9f829b13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.633881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a2cdf-0e9b-4094-9cff-28f9f829b13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.634929 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2cdf-0e9b-4094-9cff-28f9f829b13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:57.640649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a2cdf-0e9b-4094-9cff-28f9f829b13f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:57.645476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4e40-b383-4f4b-8f1c-43d1557672e5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:57.656233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:57.657521 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.657888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.658355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] PATH_INFO: `/v3/users/da8574aacf274b1f9759055845b10786` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.659977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8574aacf274b1f9759055845b10786)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:57.664493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:57.666952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 880/1766] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:57.669272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2cdf-0e9b-4094-9cff-28f9f829b13f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:57.683145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a2cdf-0e9b-4094-9cff-28f9f829b13f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:57.690143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bd31-dab4-4bb2-8bd4-6fb4f1f64992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:57.691969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bd31-dab4-4bb2-8bd4-6fb4f1f64992 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.692514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bd31-dab4-4bb2-8bd4-6fb4f1f64992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.707584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bd31-dab4-4bb2-8bd4-6fb4f1f64992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.711093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7bd31-dab4-4bb2-8bd4-6fb4f1f64992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:57.712826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7bd31-dab4-4bb2-8bd4-6fb4f1f64992 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:57.744324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 881/1767] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:57.752919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bd31-dab4-4bb2-8bd4-6fb4f1f64992 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:57.779448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8574aacf274b1f9759055845b10786'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:57.782939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bd31-dab4-4bb2-8bd4-6fb4f1f64992 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:57.812787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baccd90-4bee-4c18-9eb3-1aaaa62040b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:57.814067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baccd90-4bee-4c18-9eb3-1aaaa62040b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.814359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baccd90-4bee-4c18-9eb3-1aaaa62040b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.814684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baccd90-4bee-4c18-9eb3-1aaaa62040b7 admin admin] PATH_INFO: `/v3/projects/5f8d7f7286714aa1aae552e721e29f3c/users/a2af161b805744e0bde5d5bcfd990c8e/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.820156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:57.835531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8574aacf274b1f9759055845b10786'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:57.836595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8574aacf274b1f9759055845b10786'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:57.846463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baccd90-4bee-4c18-9eb3-1aaaa62040b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8d7f7286714aa1aae552e721e29f3c, user_id=a2af161b805744e0bde5d5bcfd990c8e, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:57.850328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baccd90-4bee-4c18-9eb3-1aaaa62040b7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:57.853336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8574aacf274b1f9759055845b10786'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:57.854322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e62130be-b82b-4607-b4df-78bede3a194c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8574aacf274b1f9759055845b10786'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:57.896474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 887/1769] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:57 2022] DELETE /identity/v3/users/da8574aacf274b1f9759055845b10786 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:28:57.898400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252312-8acd-4bc4-b3de-783b37976c67 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.899071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252312-8acd-4bc4-b3de-783b37976c67 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.899541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252312-8acd-4bc4-b3de-783b37976c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.912797 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 882/1769] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:57 2022] PUT /identity/v3/projects/5f8d7f7286714aa1aae552e721e29f3c/users/a2af161b805744e0bde5d5bcfd990c8e/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:57.914391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623c3b-8921-4b04-a4cf-6cb01fa74c55 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:57.914677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623c3b-8921-4b04-a4cf-6cb01fa74c55 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:57.914951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623c3b-8921-4b04-a4cf-6cb01fa74c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:57.950057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-42252312-8acd-4bc4-b3de-783b37976c67 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:57.952615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-42252312-8acd-4bc4-b3de-783b37976c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:57.964037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:57.980955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-75623c3b-8921-4b04-a4cf-6cb01fa74c55 None None] MFA Rules not processed for user `a2af161b805744e0bde5d5bcfd990c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:57.982936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-75623c3b-8921-4b04-a4cf-6cb01fa74c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:58.105432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 888/1770] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:58.119692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42252312-8acd-4bc4-b3de-783b37976c67 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:58.123031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-42252312-8acd-4bc4-b3de-783b37976c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:58.166096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 883/1771] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:58.172045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75623c3b-8921-4b04-a4cf-6cb01fa74c55 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:58.174703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-75623c3b-8921-4b04-a4cf-6cb01fa74c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:58.214899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75623c3b-8921-4b04-a4cf-6cb01fa74c55 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:58.226578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691fe99-12ac-4297-b8c3-cd9bb1037492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:58.227408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691fe99-12ac-4297-b8c3-cd9bb1037492 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:58.228242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691fe99-12ac-4297-b8c3-cd9bb1037492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:58.228242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691fe99-12ac-4297-b8c3-cd9bb1037492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:58.229196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691fe99-12ac-4297-b8c3-cd9bb1037492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:58.237956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691fe99-12ac-4297-b8c3-cd9bb1037492 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:58.253322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42252312-8acd-4bc4-b3de-783b37976c67 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:58.264712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe646b3-abf1-4a16-ba91-2aa6a7c1a8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:58.265845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe646b3-abf1-4a16-ba91-2aa6a7c1a8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:58.266262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe646b3-abf1-4a16-ba91-2aa6a7c1a8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:58.266637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe646b3-abf1-4a16-ba91-2aa6a7c1a8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:58.296266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe646b3-abf1-4a16-ba91-2aa6a7c1a8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:58.298078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe646b3-abf1-4a16-ba91-2aa6a7c1a8e2 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:58.303935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 884/1772] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:28:58 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:58.313691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691fe99-12ac-4297-b8c3-cd9bb1037492 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:58.323502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 889/1773] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:28:58.503336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691fe99-12ac-4297-b8c3-cd9bb1037492 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:58.512024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d226d-16c3-462d-a3da-e9726b912094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:58.513149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d226d-16c3-462d-a3da-e9726b912094 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:58.513674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d226d-16c3-462d-a3da-e9726b912094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:58.514164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d226d-16c3-462d-a3da-e9726b912094 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:58.515292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d226d-16c3-462d-a3da-e9726b912094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:58.518792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d226d-16c3-462d-a3da-e9726b912094 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:58.567981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 885/1774] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:28:58 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:28:58.573070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe646b3-abf1-4a16-ba91-2aa6a7c1a8e2 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:58.592907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe646b3-abf1-4a16-ba91-2aa6a7c1a8e2 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:58.625229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f3c3f-a965-4932-9cf0-af4deddb396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:58.629893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3c3f-a965-4932-9cf0-af4deddb396c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:58.632718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3c3f-a965-4932-9cf0-af4deddb396c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:58.633764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3c3f-a965-4932-9cf0-af4deddb396c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:58.635475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f3c3f-a965-4932-9cf0-af4deddb396c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:58.657692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f3c3f-a965-4932-9cf0-af4deddb396c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:58.679581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 890/1775] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:58.685905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d226d-16c3-462d-a3da-e9726b912094 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:58.724785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d226d-16c3-462d-a3da-e9726b912094 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:58.735388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:58.737552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:58.738162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:58.738863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] PATH_INFO: `/v3/projects/f6b4f93a7bde4af4b5c4ec40f7eb72cc/users/dc34b43fd4674d0d81ec50a16839953b/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:58.795617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b4f93a7bde4af4b5c4ec40f7eb72cc, user_id=dc34b43fd4674d0d81ec50a16839953b, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:58.800381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:58.834280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 886/1776] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:58 2022] PUT /identity/v3/projects/f6b4f93a7bde4af4b5c4ec40f7eb72cc/users/dc34b43fd4674d0d81ec50a16839953b/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:28:58.836195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f3c3f-a965-4932-9cf0-af4deddb396c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:58.856020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f3c3f-a965-4932-9cf0-af4deddb396c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:59.147397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d98f11-0037-43be-ac58-62df27a1a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:59.148194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d98f11-0037-43be-ac58-62df27a1a09b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:59.148554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d98f11-0037-43be-ac58-62df27a1a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:59.159647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d98f11-0037-43be-ac58-62df27a1a09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:59.163997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d98f11-0037-43be-ac58-62df27a1a09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:59.167961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d98f11-0037-43be-ac58-62df27a1a09b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:59.193072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:59.195687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:59.222766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357da805-1ba0-4121-82cc-7208e92d8472 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:59.233978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 891/1777] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:28:59.246554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d98f11-0037-43be-ac58-62df27a1a09b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:59.276575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:59.278092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:59.278856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:59.279170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] PATH_INFO: `/v3/users/146eac4a1ce04cb9a67522caea62ffa7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:59.288739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d98f11-0037-43be-ac58-62df27a1a09b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:59.288971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=146eac4a1ce04cb9a67522caea62ffa7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:59.304716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:59.320059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:59.332805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:59.333351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:59.335555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] PATH_INFO: `/v3/projects/f6b4f93a7bde4af4b5c4ec40f7eb72cc/users/dc34b43fd4674d0d81ec50a16839953b/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:59.336300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:59.342914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b4f93a7bde4af4b5c4ec40f7eb72cc, user_id=dc34b43fd4674d0d81ec50a16839953b, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:59.354119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:59.394037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 892/1778] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:28:59 2022] PUT /identity/v3/projects/f6b4f93a7bde4af4b5c4ec40f7eb72cc/users/dc34b43fd4674d0d81ec50a16839953b/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:59.395920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:59.407737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:59.463365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146eac4a1ce04cb9a67522caea62ffa7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:59.517065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146eac4a1ce04cb9a67522caea62ffa7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:59.519073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146eac4a1ce04cb9a67522caea62ffa7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:59.520117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146eac4a1ce04cb9a67522caea62ffa7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:59.541503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75f3b0f7-ea76-4133-983d-ae374dfb9c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146eac4a1ce04cb9a67522caea62ffa7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:28:59.569971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 887/1779] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:28:59 2022] DELETE /identity/v3/users/146eac4a1ce04cb9a67522caea62ffa7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:28:59.574989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b86a02-e2b7-4aff-8b17-c07f51042f44 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:59.575866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b86a02-e2b7-4aff-8b17-c07f51042f44 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:59.576447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b86a02-e2b7-4aff-8b17-c07f51042f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:59.578504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:59.627625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c5b86a02-e2b7-4aff-8b17-c07f51042f44 None None] MFA Rules not processed for user `dc34b43fd4674d0d81ec50a16839953b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:59.630521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c5b86a02-e2b7-4aff-8b17-c07f51042f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:59.725952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239083-9029-4aad-a2cf-c58b6f98a4ed admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:59.777015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 888/1780] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:59.778652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4bee-ad18-4fe3-ad2f-cae3b81e8ba9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:59.778810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4bee-ad18-4fe3-ad2f-cae3b81e8ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:59.779113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4bee-ad18-4fe3-ad2f-cae3b81e8ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:59.820009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e54b4bee-ad18-4fe3-ad2f-cae3b81e8ba9 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:59.826522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e54b4bee-ad18-4fe3-ad2f-cae3b81e8ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:59.916522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:59.917505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:59.917996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:59.918162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] PATH_INFO: `/v3/projects/b06e6c017afa4dda8e7f29ec953c87da` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:59.924434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06e6c017afa4dda8e7f29ec953c87da)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:59.928985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:00.056083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 889/1781] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:00.063710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b4bee-ad18-4fe3-ad2f-cae3b81e8ba9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:00.064521 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06e6c017afa4dda8e7f29ec953c87da', 'request_id': 'req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.066874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e54b4bee-ad18-4fe3-ad2f-cae3b81e8ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:00.077926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06e6c017afa4dda8e7f29ec953c87da', 'request_id': 'req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.090788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06e6c017afa4dda8e7f29ec953c87da', 'request_id': 'req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.095952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:00.120113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] The token cache is being invalidate because project b06e6c017afa4dda8e7f29ec953c87da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:00.120423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.123125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.128703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 893/1782] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:28:59 2022] DELETE /identity/v3/projects/b06e6c017afa4dda8e7f29ec953c87da => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:00.129819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:00.132496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:00.237604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b4bee-ad18-4fe3-ad2f-cae3b81e8ba9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:00.238760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a1d1-939d-4c0e-81d5-0b0c15e1087b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:00.248275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:00.249051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:00.249391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:00.249729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:00.252331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:00.321780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:00.337734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:00.344003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:00.344812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:00.345404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:00.349552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:00.490309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:00.493495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:00.529357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 894/1783] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:00.530701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:00.535258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:00.585799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c68d-cd1f-48c8-9be5-8f88f518afa1 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:00.599400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:00.620457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:00.626630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:00.637706 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:00.638133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:00.640972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] PATH_INFO: `/v3/users/cf4c4de85dd7462a8f327a66e560a2bb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:00.646279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4c4de85dd7462a8f327a66e560a2bb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:00.651764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:00.682616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 890/1784] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:00.686767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:00.712009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:00.812719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4c4de85dd7462a8f327a66e560a2bb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.815915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8962611-27fa-4d3d-986a-c3c2a01f50b2 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:00.847124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4c4de85dd7462a8f327a66e560a2bb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.849801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4c4de85dd7462a8f327a66e560a2bb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.860597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:00.862068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:00.862550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:00.862882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] PATH_INFO: `/v3/users/7c3e0f41baa34912a04b65c6c08096f3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:00.878451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3e0f41baa34912a04b65c6c08096f3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:00.879378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4c4de85dd7462a8f327a66e560a2bb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.880303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9c6f7bd3-ca77-4231-bee4-2729cc2de00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4c4de85dd7462a8f327a66e560a2bb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:00.890299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:00.916454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 895/1785] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:00 2022] DELETE /identity/v3/users/cf4c4de85dd7462a8f327a66e560a2bb => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:00.921250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8bbe9-86b7-4292-b00d-8e72bafd4ed6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:00.927268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8bbe9-86b7-4292-b00d-8e72bafd4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:00.927850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8bbe9-86b7-4292-b00d-8e72bafd4ed6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:00.929718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 896/1786] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:29:00 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:29:01.005374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb64ca-94ab-47dd-a82d-4b3ff15234d4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:01.005827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb64ca-94ab-47dd-a82d-4b3ff15234d4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:01.006297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb64ca-94ab-47dd-a82d-4b3ff15234d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:01.059780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-15eb64ca-94ab-47dd-a82d-4b3ff15234d4 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:01.064990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15eb64ca-94ab-47dd-a82d-4b3ff15234d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:01.161090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3e0f41baa34912a04b65c6c08096f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:01.191813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3e0f41baa34912a04b65c6c08096f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:01.192512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3e0f41baa34912a04b65c6c08096f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:01.193153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3e0f41baa34912a04b65c6c08096f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:01.204783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3e0f41baa34912a04b65c6c08096f3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:01.207433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:01.229886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 891/1787] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:00 2022] DELETE /identity/v3/users/7c3e0f41baa34912a04b65c6c08096f3 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:01.230870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:01.233080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:01.328766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 897/1788] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:29:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:01.334661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9486a9-6732-4b9b-ac6f-968ec8c06304 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:01.334953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9486a9-6732-4b9b-ac6f-968ec8c06304 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:01.335946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9486a9-6732-4b9b-ac6f-968ec8c06304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:01.374412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fa82b-daf7-4e64-a15c-af2329152036 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:01.388662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:01.388662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:01.388662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:01.388662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:01.389179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:01.407098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7d9486a9-6732-4b9b-ac6f-968ec8c06304 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:01.408888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d9486a9-6732-4b9b-ac6f-968ec8c06304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:01.473560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:01.591698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:01.601014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:01.620323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 892/1789] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:01.635690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:01.651197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:01.720547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 898/1790] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:01.787278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9486a9-6732-4b9b-ac6f-968ec8c06304 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:01.792147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d9486a9-6732-4b9b-ac6f-968ec8c06304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:02.063768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ee4d0-0e58-4182-a367-60277e4f352e service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:02.106110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:02.111597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:02.111761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:02.112233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:02.145105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9486a9-6732-4b9b-ac6f-968ec8c06304 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:02.171229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:02.173099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a671-860b-4744-ac1b-5d78add34605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:02.173855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a671-860b-4744-ac1b-5d78add34605 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:02.174223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a671-860b-4744-ac1b-5d78add34605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:02.174511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a671-860b-4744-ac1b-5d78add34605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:02.176730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:02.261739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 893/1791] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:02.263287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:02.270382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:02.277325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a671-860b-4744-ac1b-5d78add34605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:02.287891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a671-860b-4744-ac1b-5d78add34605 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:02.311827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 899/1792] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:02.328726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793c7cd-4cd6-4d56-8e49-97aa4283b89c service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:02.350110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:02.370064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:02.370684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:02.375591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] PATH_INFO: `/v3/projects/7f41024b0cc644feb998187eb4bd27ed` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:02.378559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f41024b0cc644feb998187eb4bd27ed)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:02.383671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:02.523936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=1,keystone:DELETE=2,keystone:SELECT=97 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:02.590234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f41024b0cc644feb998187eb4bd27ed', 'request_id': 'req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:02.623653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f41024b0cc644feb998187eb4bd27ed', 'request_id': 'req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:02.635370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f41024b0cc644feb998187eb4bd27ed', 'request_id': 'req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:02.659931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] The token cache is being invalidate because project 7f41024b0cc644feb998187eb4bd27ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:02.660590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:02.663633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:02.666687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 894/1793] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:02 2022] DELETE /identity/v3/projects/7f41024b0cc644feb998187eb4bd27ed => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:02.671156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a671-860b-4744-ac1b-5d78add34605 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:02.691909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a671-860b-4744-ac1b-5d78add34605 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:02.835301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:02.838272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:02.838854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:02.839519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] PATH_INFO: `/v3/users/37f0281bb2d54880ac7bf2ede68050c9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:02.841836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f0281bb2d54880ac7bf2ede68050c9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:02.847667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:03.057801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f0281bb2d54880ac7bf2ede68050c9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.095014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:03.095014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f0281bb2d54880ac7bf2ede68050c9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.099378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f0281bb2d54880ac7bf2ede68050c9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.122259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f0281bb2d54880ac7bf2ede68050c9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.123035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f0281bb2d54880ac7bf2ede68050c9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.153741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:03.155416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 900/1794] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:02 2022] DELETE /identity/v3/users/37f0281bb2d54880ac7bf2ede68050c9 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:03.158588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:03.228331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913ea44-c2cd-4d7e-abbe-0106bbaac8ac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:03.397833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:03.400182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:03.528882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:03.531900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:03.533322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:03.533743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] PATH_INFO: `/v3/projects/82b50bb83ad04b6a8514057ab57c6820` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:03.540864 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b50bb83ad04b6a8514057ab57c6820)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:03.569459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:03.643630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe54c-c009-4d1c-92b9-a04e11d804ae admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:03.660266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:03.661684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:03.662198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:03.662624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] PATH_INFO: `/v3/projects/08e88c547a50466c8c8168eea0d411e5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:03.667260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e88c547a50466c8c8168eea0d411e5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:03.669773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:03.758790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b50bb83ad04b6a8514057ab57c6820', 'request_id': 'req-300eefe9-542a-4355-9bc7-611a02ee632b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.775129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b50bb83ad04b6a8514057ab57c6820', 'request_id': 'req-300eefe9-542a-4355-9bc7-611a02ee632b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.793656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b50bb83ad04b6a8514057ab57c6820', 'request_id': 'req-300eefe9-542a-4355-9bc7-611a02ee632b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.800976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e88c547a50466c8c8168eea0d411e5', 'request_id': 'req-ba9b2222-25aa-4c25-ba24-cdb384cde632'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.824584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] The token cache is being invalidate because project 82b50bb83ad04b6a8514057ab57c6820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:03.827163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.827931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e88c547a50466c8c8168eea0d411e5', 'request_id': 'req-ba9b2222-25aa-4c25-ba24-cdb384cde632'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.828054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-300eefe9-542a-4355-9bc7-611a02ee632b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.829926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 895/1795] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:03 2022] DELETE /identity/v3/projects/82b50bb83ad04b6a8514057ab57c6820 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:03.835079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fde122-2d8b-4b27-a616-0ef52d6cbfc0 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:03.835374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fde122-2d8b-4b27-a616-0ef52d6cbfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:03.835667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fde122-2d8b-4b27-a616-0ef52d6cbfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:03.876657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e88c547a50466c8c8168eea0d411e5', 'request_id': 'req-ba9b2222-25aa-4c25-ba24-cdb384cde632'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.919521 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] The token cache is being invalidate because project 08e88c547a50466c8c8168eea0d411e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:03.920260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.923547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ba9b2222-25aa-4c25-ba24-cdb384cde632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:03.931387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-51fde122-2d8b-4b27-a616-0ef52d6cbfc0 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:03.931387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-51fde122-2d8b-4b27-a616-0ef52d6cbfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:03.959954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 901/1796] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:03 2022] DELETE /identity/v3/projects/08e88c547a50466c8c8168eea0d411e5 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:29:03.961814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0376d1-a6d1-4f02-b979-c675c5e68807 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:03.961995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0376d1-a6d1-4f02-b979-c675c5e68807 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:03.962320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0376d1-a6d1-4f02-b979-c675c5e68807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.017495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6d0376d1-a6d1-4f02-b979-c675c5e68807 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:04.024007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6d0376d1-a6d1-4f02-b979-c675c5e68807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:04.105998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:04.175717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 896/1797] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:04.186277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a060c3-221c-4e99-9ad8-61487b55113b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:04.186785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a060c3-221c-4e99-9ad8-61487b55113b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:04.187354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a060c3-221c-4e99-9ad8-61487b55113b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.240971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-11a060c3-221c-4e99-9ad8-61487b55113b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:04.244553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-11a060c3-221c-4e99-9ad8-61487b55113b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:04.258919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 897/1798] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:29:04.265475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 902/1799] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:04.268948 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0376d1-a6d1-4f02-b979-c675c5e68807 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:04.270882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c98b-909b-46b0-a2e5-d94e205fbe03 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:04.271464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c98b-909b-46b0-a2e5-d94e205fbe03 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:04.271957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c98b-909b-46b0-a2e5-d94e205fbe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.286185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0376d1-a6d1-4f02-b979-c675c5e68807 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:04.296190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:04.296958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:04.297243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:04.297524 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.298281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:04.298592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:04.301430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:04.310005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a1b9c98b-909b-46b0-a2e5-d94e205fbe03 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:04.312412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a1b9c98b-909b-46b0-a2e5-d94e205fbe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:04.321196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:04.325223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 898/1800] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:04.332313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c98b-909b-46b0-a2e5-d94e205fbe03 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:04.337757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 903/1801] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:04.338733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:04.353222 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c98b-909b-46b0-a2e5-d94e205fbe03 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:04.360286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:04.361382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:04.361981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:04.362468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.363462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:04.363942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:04.365672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de94809-0e47-4bd7-bb45-144d4059dbfe admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:04.366031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:04.389131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe0d5-5f26-469d-9a29-a0344f014fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:04.389899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe0d5-5f26-469d-9a29-a0344f014fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:04.390172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe0d5-5f26-469d-9a29-a0344f014fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:04.390446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe0d5-5f26-469d-9a29-a0344f014fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.391238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fe0d5-5f26-469d-9a29-a0344f014fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:04.398937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fe0d5-5f26-469d-9a29-a0344f014fc9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:04.411079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 899/1802] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:04.412826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:04.450721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e18d7b-3a8b-498a-9f75-add501f438d6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:04.457060 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30012975-ac17-4a6c-940d-fc9c2d499278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:04.458082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30012975-ac17-4a6c-940d-fc9c2d499278 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:04.458538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30012975-ac17-4a6c-940d-fc9c2d499278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:04.459037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30012975-ac17-4a6c-940d-fc9c2d499278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.460842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30012975-ac17-4a6c-940d-fc9c2d499278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:04.469230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30012975-ac17-4a6c-940d-fc9c2d499278 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:04.480942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 904/1803] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:04 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:04.481850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe0d5-5f26-469d-9a29-a0344f014fc9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:04.588608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 900/1804] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:04 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:04.589788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30012975-ac17-4a6c-940d-fc9c2d499278 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:04.757742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe0d5-5f26-469d-9a29-a0344f014fc9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:04.872535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30012975-ac17-4a6c-940d-fc9c2d499278 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:04.899273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9aa18-ac4d-4107-b2de-630de218e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:04.900002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9aa18-ac4d-4107-b2de-630de218e758 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:04.900788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9aa18-ac4d-4107-b2de-630de218e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:04.901207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9aa18-ac4d-4107-b2de-630de218e758 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.904432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9aa18-ac4d-4107-b2de-630de218e758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:04.905995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1113f7-cd1a-48f9-9334-d73bf48dee16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:04.906525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9aa18-ac4d-4107-b2de-630de218e758 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:04.906695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1113f7-cd1a-48f9-9334-d73bf48dee16 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:04.906998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1113f7-cd1a-48f9-9334-d73bf48dee16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:04.907288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1113f7-cd1a-48f9-9334-d73bf48dee16 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:04.908094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1113f7-cd1a-48f9-9334-d73bf48dee16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:04.909950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1113f7-cd1a-48f9-9334-d73bf48dee16 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:04.974602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 905/1805] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:04 2022] POST /identity/v3/users => generated 291 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:04.976168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9aa18-ac4d-4107-b2de-630de218e758 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:05.009019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9aa18-ac4d-4107-b2de-630de218e758 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:05.025045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 901/1806] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:04 2022] POST /identity/v3/users => generated 291 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:05.027770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdbdf0-588d-407d-9382-6fbb10878e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:05.029141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1113f7-cd1a-48f9-9334-d73bf48dee16 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:05.030879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdbdf0-588d-407d-9382-6fbb10878e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.032373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdbdf0-588d-407d-9382-6fbb10878e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.037180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdbdf0-588d-407d-9382-6fbb10878e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.040907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdbdf0-588d-407d-9382-6fbb10878e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:05.046234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdbdf0-588d-407d-9382-6fbb10878e47 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:05.073197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1113f7-cd1a-48f9-9334-d73bf48dee16 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:05.091129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 906/1807] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:05.094438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdbdf0-588d-407d-9382-6fbb10878e47 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:05.097516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13b2f6-2662-478a-acde-361834bf51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:05.098655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13b2f6-2662-478a-acde-361834bf51ec admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.099183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13b2f6-2662-478a-acde-361834bf51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.099638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13b2f6-2662-478a-acde-361834bf51ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.106147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13b2f6-2662-478a-acde-361834bf51ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:05.111751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13b2f6-2662-478a-acde-361834bf51ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:05.117736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdbdf0-588d-407d-9382-6fbb10878e47 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:05.147814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164874-7d7a-44d1-b635-ce34ff75a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:05.149453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164874-7d7a-44d1-b635-ce34ff75a78c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.149758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164874-7d7a-44d1-b635-ce34ff75a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.152672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164874-7d7a-44d1-b635-ce34ff75a78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.160336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6164874-7d7a-44d1-b635-ce34ff75a78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:05.164385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6164874-7d7a-44d1-b635-ce34ff75a78c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:05.195820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 902/1808] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:05.200916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13b2f6-2662-478a-acde-361834bf51ec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:05.218179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 907/1809] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:05.227233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164874-7d7a-44d1-b635-ce34ff75a78c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:05.249991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13b2f6-2662-478a-acde-361834bf51ec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:05.263133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164874-7d7a-44d1-b635-ce34ff75a78c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:05.266834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:05.267651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.268997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.270393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.272566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:05.276618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:05.287116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc275c9-da13-4019-9f17-c2d14ae5dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:05.288112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc275c9-da13-4019-9f17-c2d14ae5dd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.288399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc275c9-da13-4019-9f17-c2d14ae5dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.288679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc275c9-da13-4019-9f17-c2d14ae5dd7e admin admin] PATH_INFO: `/v3/projects/46c908b76a594588af4bf264b799505c/users/6ed71337bc8c4063a03c04172b70d11a/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.333368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 903/1810] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:05.339946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:05.349892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:05.376124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc275c9-da13-4019-9f17-c2d14ae5dd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c908b76a594588af4bf264b799505c, user_id=6ed71337bc8c4063a03c04172b70d11a, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:05.378754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc275c9-da13-4019-9f17-c2d14ae5dd7e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:05.437355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1772-42c8-43fd-9862-906d2dff64a3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:05.459317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 908/1811] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:05 2022] PUT /identity/v3/projects/46c908b76a594588af4bf264b799505c/users/6ed71337bc8c4063a03c04172b70d11a/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:05.467740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc275c9-da13-4019-9f17-c2d14ae5dd7e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:05.570430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:05.632809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:05.634527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.638156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.639041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] PATH_INFO: `/v3/projects/ba5f451f73cb41acaea0097cf2342c34` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.641360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5f451f73cb41acaea0097cf2342c34)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:05.648920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:05.660151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:05.698351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc275c9-da13-4019-9f17-c2d14ae5dd7e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:05.721458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9daabf-8875-4ef0-a248-ebf51cf0ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:05.723542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9daabf-8875-4ef0-a248-ebf51cf0ae45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.728164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9daabf-8875-4ef0-a248-ebf51cf0ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.728989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9daabf-8875-4ef0-a248-ebf51cf0ae45 admin admin] PATH_INFO: `/v3/projects/679a17081f1d427da91a48e94be36027/users/c66572716e2e49f8ab208d9be2253123/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.790917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9daabf-8875-4ef0-a248-ebf51cf0ae45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679a17081f1d427da91a48e94be36027, user_id=c66572716e2e49f8ab208d9be2253123, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:05.800271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9daabf-8875-4ef0-a248-ebf51cf0ae45 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:05.820731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 909/1812] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:05 2022] PUT /identity/v3/projects/679a17081f1d427da91a48e94be36027/users/c66572716e2e49f8ab208d9be2253123/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:05.823291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9d8c-7871-4c45-853d-29025bce36bf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.824174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9d8c-7871-4c45-853d-29025bce36bf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.825786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9d8c-7871-4c45-853d-29025bce36bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.846644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5f451f73cb41acaea0097cf2342c34', 'request_id': 'req-e9a8469d-44cd-4361-9cac-96a450c40955'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:05.857881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5f451f73cb41acaea0097cf2342c34', 'request_id': 'req-e9a8469d-44cd-4361-9cac-96a450c40955'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:05.869811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5f451f73cb41acaea0097cf2342c34', 'request_id': 'req-e9a8469d-44cd-4361-9cac-96a450c40955'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:05.882456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-245f9d8c-7871-4c45-853d-29025bce36bf None None] MFA Rules not processed for user `6ed71337bc8c4063a03c04172b70d11a`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:05.883692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-245f9d8c-7871-4c45-853d-29025bce36bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:05.888291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] The token cache is being invalidate because project ba5f451f73cb41acaea0097cf2342c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:05.889295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:05.890661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-e9a8469d-44cd-4361-9cac-96a450c40955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:05.893756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 904/1813] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:05 2022] DELETE /identity/v3/projects/ba5f451f73cb41acaea0097cf2342c34 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:05.896579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a54e-a336-4a56-8f65-79f07e91f04f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.897313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a54e-a336-4a56-8f65-79f07e91f04f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.897817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a54e-a336-4a56-8f65-79f07e91f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:05.964557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b985a54e-a336-4a56-8f65-79f07e91f04f None None] MFA Rules not processed for user `c66572716e2e49f8ab208d9be2253123`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:05.967191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b985a54e-a336-4a56-8f65-79f07e91f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:05.981453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 910/1814] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:05.981453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52047f6-a425-46e1-886a-ffec52fda0b6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:05.981453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52047f6-a425-46e1-886a-ffec52fda0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:05.982195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52047f6-a425-46e1-886a-ffec52fda0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.026605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a52047f6-a425-46e1-886a-ffec52fda0b6 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:06.028070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a52047f6-a425-46e1-886a-ffec52fda0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:06.114795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 905/1815] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:06.116162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a54e-a336-4a56-8f65-79f07e91f04f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.119026 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b985a54e-a336-4a56-8f65-79f07e91f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:06.197008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 911/1816] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:06.198367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52047f6-a425-46e1-886a-ffec52fda0b6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.200374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a52047f6-a425-46e1-886a-ffec52fda0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:06.215765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52047f6-a425-46e1-886a-ffec52fda0b6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.222938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ad1cd-aa8c-4abe-9256-b4a4f47eb4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.224231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ad1cd-aa8c-4abe-9256-b4a4f47eb4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.224860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ad1cd-aa8c-4abe-9256-b4a4f47eb4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.225274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ad1cd-aa8c-4abe-9256-b4a4f47eb4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.232361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ad1cd-aa8c-4abe-9256-b4a4f47eb4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:06.234874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ad1cd-aa8c-4abe-9256-b4a4f47eb4e0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:06.279722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a54e-a336-4a56-8f65-79f07e91f04f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.292465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e596f75-23d2-47f4-b7a3-8d1c31080e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.293290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e596f75-23d2-47f4-b7a3-8d1c31080e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.293613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e596f75-23d2-47f4-b7a3-8d1c31080e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.293965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e596f75-23d2-47f4-b7a3-8d1c31080e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.295134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e596f75-23d2-47f4-b7a3-8d1c31080e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:06.297239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e596f75-23d2-47f4-b7a3-8d1c31080e02 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:06.301941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 912/1817] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:06 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:06.302583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61c81-6ee2-4df2-af3c-2136573e5bcd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.303905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61c81-6ee2-4df2-af3c-2136573e5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.304300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61c81-6ee2-4df2-af3c-2136573e5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.352828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6bf61c81-6ee2-4df2-af3c-2136573e5bcd None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:06.354269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6bf61c81-6ee2-4df2-af3c-2136573e5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:06.361847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 906/1818] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:06 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:06.361847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e596f75-23d2-47f4-b7a3-8d1c31080e02 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.373730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:06.387745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:06.509918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e596f75-23d2-47f4-b7a3-8d1c31080e02 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.516990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634d0af-0bd6-40b1-878d-034cd0455d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.518699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634d0af-0bd6-40b1-878d-034cd0455d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.519663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634d0af-0bd6-40b1-878d-034cd0455d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.520442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634d0af-0bd6-40b1-878d-034cd0455d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.522789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634d0af-0bd6-40b1-878d-034cd0455d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:06.525402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634d0af-0bd6-40b1-878d-034cd0455d8e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:06.558442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 913/1819] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:06.559174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61c81-6ee2-4df2-af3c-2136573e5bcd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.563649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 907/1820] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:06 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:06.565362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634d0af-0bd6-40b1-878d-034cd0455d8e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.583970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61c81-6ee2-4df2-af3c-2136573e5bcd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.608042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634d0af-0bd6-40b1-878d-034cd0455d8e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.608733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390684-3c3f-41ec-a0ad-f8bd3e2e0b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.615406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390684-3c3f-41ec-a0ad-f8bd3e2e0b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.615869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390684-3c3f-41ec-a0ad-f8bd3e2e0b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.616345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390684-3c3f-41ec-a0ad-f8bd3e2e0b54 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.617512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45390684-3c3f-41ec-a0ad-f8bd3e2e0b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:06.618073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.619323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.619936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.620502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45390684-3c3f-41ec-a0ad-f8bd3e2e0b54 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:06.620986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.622718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:06.623678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:06.627743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:06.655757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 908/1821] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:06.660447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.690599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 914/1822] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:06 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:06.691730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390684-3c3f-41ec-a0ad-f8bd3e2e0b54 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.696937 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bd438-f1e5-4a0c-a7ca-aa53343131de admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.703243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764a2b9-09f9-4db5-9a5b-9e9410dfff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.705424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a2b9-09f9-4db5-9a5b-9e9410dfff68 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.705872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a2b9-09f9-4db5-9a5b-9e9410dfff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.706729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a2b9-09f9-4db5-9a5b-9e9410dfff68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.708469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764a2b9-09f9-4db5-9a5b-9e9410dfff68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:06.712391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764a2b9-09f9-4db5-9a5b-9e9410dfff68 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:06.723433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390684-3c3f-41ec-a0ad-f8bd3e2e0b54 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.731562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a3d89-7958-4676-9e3a-5aba3009ce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.732766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3d89-7958-4676-9e3a-5aba3009ce53 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.734222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3d89-7958-4676-9e3a-5aba3009ce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.734222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a3d89-7958-4676-9e3a-5aba3009ce53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.735409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a3d89-7958-4676-9e3a-5aba3009ce53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:06.736782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 909/1823] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:06.739750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a3d89-7958-4676-9e3a-5aba3009ce53 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:06.740621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764a2b9-09f9-4db5-9a5b-9e9410dfff68 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.764280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764a2b9-09f9-4db5-9a5b-9e9410dfff68 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.793179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a26544-3ef0-4cf0-8a9c-f00676adba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.795296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a26544-3ef0-4cf0-8a9c-f00676adba84 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.795623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a26544-3ef0-4cf0-8a9c-f00676adba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.795897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a26544-3ef0-4cf0-8a9c-f00676adba84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:06.798912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a26544-3ef0-4cf0-8a9c-f00676adba84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:06.803207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a26544-3ef0-4cf0-8a9c-f00676adba84 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:06.831011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 915/1824] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:06 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:06.834372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a3d89-7958-4676-9e3a-5aba3009ce53 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.834841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 910/1825] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:06.837194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a26544-3ef0-4cf0-8a9c-f00676adba84 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:06.877706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a26544-3ef0-4cf0-8a9c-f00676adba84 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:06.979857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e4da-38a5-4228-bfcd-b6c0ef6f0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:06.980981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e4da-38a5-4228-bfcd-b6c0ef6f0837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:06.981355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e4da-38a5-4228-bfcd-b6c0ef6f0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:06.981833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e4da-38a5-4228-bfcd-b6c0ef6f0837 admin admin] PATH_INFO: `/v3/projects/91229ab5789545e6891c9f73e4d9d5f3/users/222755917dad4b149abef7b19664888b/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.001834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a3d89-7958-4676-9e3a-5aba3009ce53 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.009934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3e4da-38a5-4228-bfcd-b6c0ef6f0837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91229ab5789545e6891c9f73e4d9d5f3, user_id=222755917dad4b149abef7b19664888b, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.011320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bec87-6bae-48b6-ba09-2cc5a8b46852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.013044 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bec87-6bae-48b6-ba09-2cc5a8b46852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.013222 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3e4da-38a5-4228-bfcd-b6c0ef6f0837 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.013903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bec87-6bae-48b6-ba09-2cc5a8b46852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.014552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bec87-6bae-48b6-ba09-2cc5a8b46852 admin admin] PATH_INFO: `/v3/projects/9c919c0943ce4040aeb3682962b7618f/users/36487d6d90e24c9b92bcf4fd3f8cc400/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.042421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 911/1826] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:06 2022] PUT /identity/v3/projects/91229ab5789545e6891c9f73e4d9d5f3/users/222755917dad4b149abef7b19664888b/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:07.048931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e4da-38a5-4228-bfcd-b6c0ef6f0837 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.050620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bec87-6bae-48b6-ba09-2cc5a8b46852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c919c0943ce4040aeb3682962b7618f, user_id=36487d6d90e24c9b92bcf4fd3f8cc400, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.054816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bec87-6bae-48b6-ba09-2cc5a8b46852 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.073826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 916/1827] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:06 2022] PUT /identity/v3/projects/9c919c0943ce4040aeb3682962b7618f/users/36487d6d90e24c9b92bcf4fd3f8cc400/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:07.075506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bec87-6bae-48b6-ba09-2cc5a8b46852 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.171861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bec87-6bae-48b6-ba09-2cc5a8b46852 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.177500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ce620-7b40-43c6-bba1-31b282bd760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.178332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce620-7b40-43c6-bba1-31b282bd760f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.178721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce620-7b40-43c6-bba1-31b282bd760f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.179168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ce620-7b40-43c6-bba1-31b282bd760f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.179991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ce620-7b40-43c6-bba1-31b282bd760f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.182007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ce620-7b40-43c6-bba1-31b282bd760f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.184960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:07.199754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:07.215957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 917/1828] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:07.215957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ce620-7b40-43c6-bba1-31b282bd760f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.231770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e4da-38a5-4228-bfcd-b6c0ef6f0837 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.235031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ce620-7b40-43c6-bba1-31b282bd760f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.237388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9241633-13df-42fd-bd07-7ba25a27d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.238191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9241633-13df-42fd-bd07-7ba25a27d187 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.238477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9241633-13df-42fd-bd07-7ba25a27d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.238953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9241633-13df-42fd-bd07-7ba25a27d187 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.239697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9241633-13df-42fd-bd07-7ba25a27d187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.242480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9241633-13df-42fd-bd07-7ba25a27d187 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.270262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af053a-e7cd-49d0-a011-f7001a134033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.271147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af053a-e7cd-49d0-a011-f7001a134033 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.273523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af053a-e7cd-49d0-a011-f7001a134033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.274149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af053a-e7cd-49d0-a011-f7001a134033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.275509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af053a-e7cd-49d0-a011-f7001a134033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.278156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 912/1829] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:07 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:07.279282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9241633-13df-42fd-bd07-7ba25a27d187 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.280124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af053a-e7cd-49d0-a011-f7001a134033 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.290372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9241633-13df-42fd-bd07-7ba25a27d187 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.296533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7c688-caa2-4402-b9c0-7c677e0b88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.297569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7c688-caa2-4402-b9c0-7c677e0b88d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.297862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7c688-caa2-4402-b9c0-7c677e0b88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.298134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7c688-caa2-4402-b9c0-7c677e0b88d0 admin admin] PATH_INFO: `/v3/projects/91229ab5789545e6891c9f73e4d9d5f3/users/222755917dad4b149abef7b19664888b/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.300185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7c688-caa2-4402-b9c0-7c677e0b88d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91229ab5789545e6891c9f73e4d9d5f3, user_id=222755917dad4b149abef7b19664888b, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.305465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7c688-caa2-4402-b9c0-7c677e0b88d0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.310359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 918/1830] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:07.312858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af053a-e7cd-49d0-a011-f7001a134033 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.321985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 913/1831] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:07 2022] PUT /identity/v3/projects/91229ab5789545e6891c9f73e4d9d5f3/users/222755917dad4b149abef7b19664888b/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:07.322991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7c688-caa2-4402-b9c0-7c677e0b88d0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.336839 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af053a-e7cd-49d0-a011-f7001a134033 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.435764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b62b-8f74-4bf1-87d3-557f6a65fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.437455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b62b-8f74-4bf1-87d3-557f6a65fac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.438319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b62b-8f74-4bf1-87d3-557f6a65fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.439412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b62b-8f74-4bf1-87d3-557f6a65fac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.441573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b62b-8f74-4bf1-87d3-557f6a65fac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.443950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b62b-8f74-4bf1-87d3-557f6a65fac0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.458147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 919/1832] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:07.460123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b26fb4-0228-48c5-b21b-893c692532f7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.460830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b26fb4-0228-48c5-b21b-893c692532f7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.461712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b26fb4-0228-48c5-b21b-893c692532f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.494914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e7b26fb4-0228-48c5-b21b-893c692532f7 None None] MFA Rules not processed for user `222755917dad4b149abef7b19664888b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:07.496878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e7b26fb4-0228-48c5-b21b-893c692532f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:07.516951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7c688-caa2-4402-b9c0-7c677e0b88d0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.529649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55038c-1923-4442-8d33-4dd22c7ead31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.533642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55038c-1923-4442-8d33-4dd22c7ead31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.533918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55038c-1923-4442-8d33-4dd22c7ead31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.534252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55038c-1923-4442-8d33-4dd22c7ead31 admin admin] PATH_INFO: `/v3/projects/9c919c0943ce4040aeb3682962b7618f/users/36487d6d90e24c9b92bcf4fd3f8cc400/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.542661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55038c-1923-4442-8d33-4dd22c7ead31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c919c0943ce4040aeb3682962b7618f, user_id=36487d6d90e24c9b92bcf4fd3f8cc400, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.549130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55038c-1923-4442-8d33-4dd22c7ead31 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.590213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 920/1833] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:07.592602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b26fb4-0228-48c5-b21b-893c692532f7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.607840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b26fb4-0228-48c5-b21b-893c692532f7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.614041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 914/1834] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:07 2022] PUT /identity/v3/projects/9c919c0943ce4040aeb3682962b7618f/users/36487d6d90e24c9b92bcf4fd3f8cc400/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:07.630163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32a2e7-86f0-4fba-9789-b270bd19db26 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.631387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32a2e7-86f0-4fba-9789-b270bd19db26 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.631805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32a2e7-86f0-4fba-9789-b270bd19db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.695785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ebba1-a211-4cfe-8614-a1af61ee5ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.696877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebba1-a211-4cfe-8614-a1af61ee5ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.697418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebba1-a211-4cfe-8614-a1af61ee5ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.697910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebba1-a211-4cfe-8614-a1af61ee5ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.699039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ebba1-a211-4cfe-8614-a1af61ee5ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.701034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ebba1-a211-4cfe-8614-a1af61ee5ebc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.726905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 921/1835] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:07.738780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4a32a2e7-86f0-4fba-9789-b270bd19db26 None None] MFA Rules not processed for user `36487d6d90e24c9b92bcf4fd3f8cc400`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:07.739542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ebba1-a211-4cfe-8614-a1af61ee5ebc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.740050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4a32a2e7-86f0-4fba-9789-b270bd19db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:07.764127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:07.781573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ebba1-a211-4cfe-8614-a1af61ee5ebc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:07.807035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:07.808133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:07.809599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:07.809954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] PATH_INFO: `/v3/projects/784cb700e18247c78ef318d8eb80f8be/users/0fa41a92f5514d7590c71cc5e7f121f7/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:07.845836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=784cb700e18247c78ef318d8eb80f8be, user_id=0fa41a92f5514d7590c71cc5e7f121f7, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:07.884260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:07.943548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 922/1836] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:07 2022] PUT /identity/v3/projects/784cb700e18247c78ef318d8eb80f8be/users/0fa41a92f5514d7590c71cc5e7f121f7/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:07.953290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:07.961501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.176177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 915/1837] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 547 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:08.178197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32a2e7-86f0-4fba-9789-b270bd19db26 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:08.180792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4a32a2e7-86f0-4fba-9789-b270bd19db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.229880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a26c46-fddd-43c3-bd6b-f76ae8d45b4e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:08.253688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:08.254714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.255104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.256041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] PATH_INFO: `/v3/users/a2af161b805744e0bde5d5bcfd990c8e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.260325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2af161b805744e0bde5d5bcfd990c8e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:08.261248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:08.263913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:08.279831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32a2e7-86f0-4fba-9789-b270bd19db26 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:08.338690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2af161b805744e0bde5d5bcfd990c8e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:08.357220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2af161b805744e0bde5d5bcfd990c8e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:08.360230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2af161b805744e0bde5d5bcfd990c8e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:08.368409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2af161b805744e0bde5d5bcfd990c8e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:08.368868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-304b89f3-aa13-4793-af94-0fc5b64ccdb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2af161b805744e0bde5d5bcfd990c8e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:08.372131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:08.372724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.372724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.372880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.374944 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.396467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 923/1838] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:07 2022] DELETE /identity/v3/users/a2af161b805744e0bde5d5bcfd990c8e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:08.398092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63039f2c-ffef-4ad1-bb2b-3f8423d10440 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.398652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63039f2c-ffef-4ad1-bb2b-3f8423d10440 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.398774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63039f2c-ffef-4ad1-bb2b-3f8423d10440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.428881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-63039f2c-ffef-4ad1-bb2b-3f8423d10440 None None] MFA Rules not processed for user `0fa41a92f5514d7590c71cc5e7f121f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:08.430477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-63039f2c-ffef-4ad1-bb2b-3f8423d10440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.461713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:08.463188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:08.479590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 916/1839] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:08.480684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:08.482153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.488554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:08.495135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27658f1-83b6-46a2-b612-d864af6f049e service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:08.512467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 924/1840] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:08.513690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaacbcf-85db-47ed-8a4e-04b43bf0254b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.513973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaacbcf-85db-47ed-8a4e-04b43bf0254b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.514238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaacbcf-85db-47ed-8a4e-04b43bf0254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.539270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2aaacbcf-85db-47ed-8a4e-04b43bf0254b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:08.541232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2aaacbcf-85db-47ed-8a4e-04b43bf0254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.562123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:08.563198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.563668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.564122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.566900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.612824 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 925/1841] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:08.614084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaacbcf-85db-47ed-8a4e-04b43bf0254b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:08.617925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2aaacbcf-85db-47ed-8a4e-04b43bf0254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.638022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaacbcf-85db-47ed-8a4e-04b43bf0254b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:08.646278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc8d3-ba5d-46b5-b048-813ffd82ef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:08.647442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc8d3-ba5d-46b5-b048-813ffd82ef2b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.647916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc8d3-ba5d-46b5-b048-813ffd82ef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.648376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc8d3-ba5d-46b5-b048-813ffd82ef2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.649593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebc8d3-ba5d-46b5-b048-813ffd82ef2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:08.653355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebc8d3-ba5d-46b5-b048-813ffd82ef2b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:08.657441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:08.658982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:08.663700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:08.673670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 917/1842] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:08.674854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:08.677322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.702752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 926/1843] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:08 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:08.708371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc8d3-ba5d-46b5-b048-813ffd82ef2b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:08.800213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b4c75-9982-454f-977b-11ff86571911 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:08.803238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc8d3-ba5d-46b5-b048-813ffd82ef2b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:08.808553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc255-5846-4502-9776-dea03fec4191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:08.809333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc255-5846-4502-9776-dea03fec4191 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.809693 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc255-5846-4502-9776-dea03fec4191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.810009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc255-5846-4502-9776-dea03fec4191 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.810974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc255-5846-4502-9776-dea03fec4191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:08.813150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc255-5846-4502-9776-dea03fec4191 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:08.839787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 927/1844] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:08 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:29:08.852156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc255-5846-4502-9776-dea03fec4191 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:08.865411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc255-5846-4502-9776-dea03fec4191 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:08.874655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd174-5d2d-4221-bc2f-a882a9e0be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:08.875631 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd174-5d2d-4221-bc2f-a882a9e0be03 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.875916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd174-5d2d-4221-bc2f-a882a9e0be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.876286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd174-5d2d-4221-bc2f-a882a9e0be03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.877112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dd174-5d2d-4221-bc2f-a882a9e0be03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:08.879359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dd174-5d2d-4221-bc2f-a882a9e0be03 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:08.893105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 928/1845] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:08.897361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd174-5d2d-4221-bc2f-a882a9e0be03 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:08.897560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:08.898567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.899370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.900093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.907710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd174-5d2d-4221-bc2f-a882a9e0be03 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:08.912863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a0dbe-2a36-4863-b8c6-06c041372bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:08.914019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a0dbe-2a36-4863-b8c6-06c041372bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:08.914397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a0dbe-2a36-4863-b8c6-06c041372bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:08.914823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a0dbe-2a36-4863-b8c6-06c041372bdc admin admin] PATH_INFO: `/v3/projects/106ee49ecc3643a3ae0efbde1f1e3752/users/7c2a7b7bf48540a1be15ca2be1122a60/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:08.915432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:08.918061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:08.936327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a0dbe-2a36-4863-b8c6-06c041372bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=106ee49ecc3643a3ae0efbde1f1e3752, user_id=7c2a7b7bf48540a1be15ca2be1122a60, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:08.940700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a0dbe-2a36-4863-b8c6-06c041372bdc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:08.951731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 918/1846] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:08.953637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:08.960812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:08.970794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 929/1847] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:08 2022] PUT /identity/v3/projects/106ee49ecc3643a3ae0efbde1f1e3752/users/7c2a7b7bf48540a1be15ca2be1122a60/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:08.971811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a0dbe-2a36-4863-b8c6-06c041372bdc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.009374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:09.050489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a426c-6a15-409b-bcd8-c4522f5bfcaa service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.080287 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a0dbe-2a36-4863-b8c6-06c041372bdc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.086100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a142ad-464b-44ee-8484-70e3f6d0e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:09.087211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a142ad-464b-44ee-8484-70e3f6d0e30e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.087716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a142ad-464b-44ee-8484-70e3f6d0e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.088091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a142ad-464b-44ee-8484-70e3f6d0e30e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.089650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a142ad-464b-44ee-8484-70e3f6d0e30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:09.091479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a142ad-464b-44ee-8484-70e3f6d0e30e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:09.106811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 930/1848] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:09.107984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a142ad-464b-44ee-8484-70e3f6d0e30e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.138381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:09.139759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.139891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.140250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.146319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:09.201543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:09.241816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a142ad-464b-44ee-8484-70e3f6d0e30e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.249588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222755917dad4b149abef7b19664888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91229ab5789545e6891c9f73e4d9d5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:09.250725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.251536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.251536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.252425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:09.252784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:09.254666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:09.282657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 931/1849] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:09.285425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:09.287017 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.288108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:09.304998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 919/1850] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:09.307102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.315677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39e965-af6a-42d5-b3dc-b29380f60ac7 tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.323171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3376f4-be86-441e-9f5f-af9f80ac0bae service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.330282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0b59d-3ca7-42a4-a0e9-f06a510d6b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:09.331137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e671d1-411c-479c-98f5-685ed07bc5cc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222755917dad4b149abef7b19664888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91229ab5789545e6891c9f73e4d9d5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:09.331549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0b59d-3ca7-42a4-a0e9-f06a510d6b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.331926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0b59d-3ca7-42a4-a0e9-f06a510d6b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.332311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0b59d-3ca7-42a4-a0e9-f06a510d6b2d admin admin] PATH_INFO: `/v3/projects/106ee49ecc3643a3ae0efbde1f1e3752/users/7c2a7b7bf48540a1be15ca2be1122a60/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.332536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e671d1-411c-479c-98f5-685ed07bc5cc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.332971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e671d1-411c-479c-98f5-685ed07bc5cc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.333384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e671d1-411c-479c-98f5-685ed07bc5cc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.335150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e671d1-411c-479c-98f5-685ed07bc5cc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:09.336029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0b59d-3ca7-42a4-a0e9-f06a510d6b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=106ee49ecc3643a3ae0efbde1f1e3752, user_id=7c2a7b7bf48540a1be15ca2be1122a60, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:09.337905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e671d1-411c-479c-98f5-685ed07bc5cc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:09.340967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0b59d-3ca7-42a4-a0e9-f06a510d6b2d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:09.387005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 932/1851] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:09 2022] PUT /identity/v3/projects/106ee49ecc3643a3ae0efbde1f1e3752/users/7c2a7b7bf48540a1be15ca2be1122a60/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:09.392349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855c32d-e277-4d15-b625-c9d342b778d6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.392781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855c32d-e277-4d15-b625-c9d342b778d6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.393180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855c32d-e277-4d15-b625-c9d342b778d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.403593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 920/1852] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:09 2022] POST /identity/v3/projects => generated 354 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:09.414245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e671d1-411c-479c-98f5-685ed07bc5cc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.459212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6855c32d-e277-4d15-b625-c9d342b778d6 None None] MFA Rules not processed for user `7c2a7b7bf48540a1be15ca2be1122a60`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:09.461169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6855c32d-e277-4d15-b625-c9d342b778d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:09.597199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 933/1853] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:29:09.600353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855c32d-e277-4d15-b625-c9d342b778d6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.602931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6855c32d-e277-4d15-b625-c9d342b778d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:09.630251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e671d1-411c-479c-98f5-685ed07bc5cc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.635444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222755917dad4b149abef7b19664888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91229ab5789545e6891c9f73e4d9d5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:09.636327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.636626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.637386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.638552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:09.638986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:09.641577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:09.660362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 921/1854] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:09.660362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.665904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:09.727975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855c32d-e277-4d15-b625-c9d342b778d6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.733618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:09.734751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.735077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.737440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] PATH_INFO: `/v3/projects/5f8d7f7286714aa1aae552e721e29f3c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.737440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8d7f7286714aa1aae552e721e29f3c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:09.738857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:09.745185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c80b3-0460-406a-89e7-cc27f21bf2dc tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.749856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f2e6-d43b-4c1d-8390-eddaab6aac33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:09.750526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f2e6-d43b-4c1d-8390-eddaab6aac33 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:09.750808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f2e6-d43b-4c1d-8390-eddaab6aac33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:09.751170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f2e6-d43b-4c1d-8390-eddaab6aac33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:09.765691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4f2e6-d43b-4c1d-8390-eddaab6aac33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:09.767245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4f2e6-d43b-4c1d-8390-eddaab6aac33 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:09.778102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 922/1855] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:09.829729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8d7f7286714aa1aae552e721e29f3c', 'request_id': 'req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:09.843528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8d7f7286714aa1aae552e721e29f3c', 'request_id': 'req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:09.863061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8d7f7286714aa1aae552e721e29f3c', 'request_id': 'req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:09.891830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] The token cache is being invalidate because project 5f8d7f7286714aa1aae552e721e29f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:09.897838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:09.899471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:09.900229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f2e6-d43b-4c1d-8390-eddaab6aac33 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.902989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 934/1856] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:09 2022] DELETE /identity/v3/projects/5f8d7f7286714aa1aae552e721e29f3c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:09.906624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:09.908472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:09.926213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f2e6-d43b-4c1d-8390-eddaab6aac33 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:09.994268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:10.005324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1bfa3-5e4f-4135-ab72-511593e6dc69 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:10.011113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:10.012418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:10.012675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:10.012956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] PATH_INFO: `/v3/users/dc34b43fd4674d0d81ec50a16839953b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:10.014236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc34b43fd4674d0d81ec50a16839953b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:10.016246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:10.026872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222755917dad4b149abef7b19664888b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91229ab5789545e6891c9f73e4d9d5f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:10.027833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:10.028088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:10.028353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] PATH_INFO: `/v3/projects/fe552c7cda1b4c3bb5ffa05142f9985c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:10.029952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fe552c7cda1b4c3bb5ffa05142f9985c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:10.031872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:10.096221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc34b43fd4674d0d81ec50a16839953b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.105246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:10.106108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe552c7cda1b4c3bb5ffa05142f9985c', 'request_id': 'req-8556d98c-4d08-4944-91a1-374ba32bcc4a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.114006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc34b43fd4674d0d81ec50a16839953b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.119647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe552c7cda1b4c3bb5ffa05142f9985c', 'request_id': 'req-8556d98c-4d08-4944-91a1-374ba32bcc4a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.124954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc34b43fd4674d0d81ec50a16839953b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.137233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc34b43fd4674d0d81ec50a16839953b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.137984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc34b43fd4674d0d81ec50a16839953b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.144204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe552c7cda1b4c3bb5ffa05142f9985c', 'request_id': 'req-8556d98c-4d08-4944-91a1-374ba32bcc4a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.156743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 935/1857] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:09 2022] DELETE /identity/v3/users/dc34b43fd4674d0d81ec50a16839953b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:29:10.158336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:10.159930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:10.173008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] The token cache is being invalidate because project fe552c7cda1b4c3bb5ffa05142f9985c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:10.173331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.174259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:10.176053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 923/1858] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:09 2022] DELETE /identity/v3/projects/fe552c7cda1b4c3bb5ffa05142f9985c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:10.262669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362225ff-5a62-48ed-b79b-68922e4be1fa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:10.279492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:10.280192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:10.280687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:10.281178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:10.283799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:10.388477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:10.390564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:10.406289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 936/1859] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:10.623634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:10.626834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:10.848237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:10.850221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:10.935220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d98c-4d08-4944-91a1-374ba32bcc4a tempest-VolumeQuotaClassesTest-1615839734 tempest-VolumeQuotaClassesTest-1615839734-project-admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.016886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788b22-8a6c-4fef-a4a1-2a1b8e3bb736 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.030075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.031939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.032876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.033366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] PATH_INFO: `/v3/users/6ed71337bc8c4063a03c04172b70d11a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.036765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed71337bc8c4063a03c04172b70d11a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.041158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.062336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.063363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.064532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.064820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] PATH_INFO: `/v3/projects/f6b4f93a7bde4af4b5c4ec40f7eb72cc` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.066252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b4f93a7bde4af4b5c4ec40f7eb72cc)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.068269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.097173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:11.118664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:11.144727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b4f93a7bde4af4b5c4ec40f7eb72cc', 'request_id': 'req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.163999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b4f93a7bde4af4b5c4ec40f7eb72cc', 'request_id': 'req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.166372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed71337bc8c4063a03c04172b70d11a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.175313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b4f93a7bde4af4b5c4ec40f7eb72cc', 'request_id': 'req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.197329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] The token cache is being invalidate because project f6b4f93a7bde4af4b5c4ec40f7eb72cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:11.197694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.198387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c139ee67-0f5a-4ded-b8ad-84fb62316fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.200834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 924/1860] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:10 2022] DELETE /identity/v3/projects/f6b4f93a7bde4af4b5c4ec40f7eb72cc => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:11.205749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed71337bc8c4063a03c04172b70d11a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.205749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed71337bc8c4063a03c04172b70d11a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.210900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0caca7-b45b-412e-844e-f0fe9f3a7f3c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.212322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0caca7-b45b-412e-844e-f0fe9f3a7f3c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.212633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0caca7-b45b-412e-844e-f0fe9f3a7f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.218633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed71337bc8c4063a03c04172b70d11a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.220956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-974734bd-95ef-45a9-ada2-cb3f82244722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed71337bc8c4063a03c04172b70d11a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:11.254120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ca0caca7-b45b-412e-844e-f0fe9f3a7f3c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:11.255269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 937/1861] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:10 2022] DELETE /identity/v3/users/6ed71337bc8c4063a03c04172b70d11a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:11.255408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca0caca7-b45b-412e-844e-f0fe9f3a7f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:11.259562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b2d9-77ca-43a2-868f-e2cb2d6dd938 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.259911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b2d9-77ca-43a2-868f-e2cb2d6dd938 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.260389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b2d9-77ca-43a2-868f-e2cb2d6dd938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.294956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c4d8b2d9-77ca-43a2-868f-e2cb2d6dd938 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:11.296740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c4d8b2d9-77ca-43a2-868f-e2cb2d6dd938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:11.370663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 925/1862] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:11.378832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c4b96-6187-4622-84b9-2b7d336b6709 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.379135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c4b96-6187-4622-84b9-2b7d336b6709 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.379343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c4b96-6187-4622-84b9-2b7d336b6709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.422115 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a16c4b96-6187-4622-84b9-2b7d336b6709 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:11.423709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a16c4b96-6187-4622-84b9-2b7d336b6709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:11.433191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 938/1863] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:29:11.440513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 926/1864] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:11.443582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8b2d9-77ca-43a2-868f-e2cb2d6dd938 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:11.445472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c4b96-6187-4622-84b9-2b7d336b6709 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:11.453439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a16c4b96-6187-4622-84b9-2b7d336b6709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:11.456377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8b2d9-77ca-43a2-868f-e2cb2d6dd938 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.461605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.463307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.463578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.463958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.464980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:11.465649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.471473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.490089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 939/1865] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:11.496260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:11.515798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee636687-c6f9-4a0b-afd5-d40485bbbde3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.521147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab56bf-8d69-4695-9e10-bef9737df2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.521962 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab56bf-8d69-4695-9e10-bef9737df2ff admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.522245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab56bf-8d69-4695-9e10-bef9737df2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.522517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab56bf-8d69-4695-9e10-bef9737df2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.523292 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab56bf-8d69-4695-9e10-bef9737df2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.525316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab56bf-8d69-4695-9e10-bef9737df2ff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.541806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c4b96-6187-4622-84b9-2b7d336b6709 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.550659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5375-8ebd-426e-b9c1-36fbb92f606a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.551641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5375-8ebd-426e-b9c1-36fbb92f606a service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.552046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5375-8ebd-426e-b9c1-36fbb92f606a service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.552454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5375-8ebd-426e-b9c1-36fbb92f606a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.564187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd5375-8ebd-426e-b9c1-36fbb92f606a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.567889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd5375-8ebd-426e-b9c1-36fbb92f606a service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.568229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 940/1866] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:11 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:11.569372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab56bf-8d69-4695-9e10-bef9737df2ff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:11.576546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 927/1867] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:29:11.674274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab56bf-8d69-4695-9e10-bef9737df2ff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.679838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03cf03-5249-498a-a957-3fa8d44847b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.680677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03cf03-5249-498a-a957-3fa8d44847b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.682203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03cf03-5249-498a-a957-3fa8d44847b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.682203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03cf03-5249-498a-a957-3fa8d44847b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.682543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03cf03-5249-498a-a957-3fa8d44847b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.684854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03cf03-5249-498a-a957-3fa8d44847b2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.715008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 941/1868] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:11 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:11.720229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5375-8ebd-426e-b9c1-36fbb92f606a service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:11.730413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5375-8ebd-426e-b9c1-36fbb92f606a service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.737669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206122bc-5f9a-4bbb-9d02-bfc972eb4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.742400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206122bc-5f9a-4bbb-9d02-bfc972eb4a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.742760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206122bc-5f9a-4bbb-9d02-bfc972eb4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.743056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206122bc-5f9a-4bbb-9d02-bfc972eb4a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.743918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206122bc-5f9a-4bbb-9d02-bfc972eb4a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.747056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206122bc-5f9a-4bbb-9d02-bfc972eb4a6c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.764136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 928/1869] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:29:11.775358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03cf03-5249-498a-a957-3fa8d44847b2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:11.788622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:11.799603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03cf03-5249-498a-a957-3fa8d44847b2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.813039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2191047-32d5-401e-8cc6-8968f5dbf81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.814073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191047-32d5-401e-8cc6-8968f5dbf81d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.814373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191047-32d5-401e-8cc6-8968f5dbf81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.814640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191047-32d5-401e-8cc6-8968f5dbf81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.815804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2191047-32d5-401e-8cc6-8968f5dbf81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.817975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2191047-32d5-401e-8cc6-8968f5dbf81d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.835018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 942/1870] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:11.839033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206122bc-5f9a-4bbb-9d02-bfc972eb4a6c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:11.852307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206122bc-5f9a-4bbb-9d02-bfc972eb4a6c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:11.857973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:11.858879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.859272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.859559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] PATH_INFO: `/v3/projects/2cfb2a274e104f2a9776139bd1a8c12e/users/d200bf295217427f84888a9c112ccbb2/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.881895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfb2a274e104f2a9776139bd1a8c12e, user_id=d200bf295217427f84888a9c112ccbb2, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:11.885089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:11.911477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 929/1871] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:11 2022] PUT /identity/v3/projects/2cfb2a274e104f2a9776139bd1a8c12e/users/d200bf295217427f84888a9c112ccbb2/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:29:11.924221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27446-f094-4576-bcba-2fd4b5363eb0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:11.924942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27446-f094-4576-bcba-2fd4b5363eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:11.925546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27446-f094-4576-bcba-2fd4b5363eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:11.980536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-33d27446-f094-4576-bcba-2fd4b5363eb0 None None] MFA Rules not processed for user `d200bf295217427f84888a9c112ccbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:11.980536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-33d27446-f094-4576-bcba-2fd4b5363eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:11.988689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:11.991852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:12.029404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:12.120878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf23b3-3d4a-47da-be59-0c4d2073479c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:12.132490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:12.133322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:12.133827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:12.135131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] PATH_INFO: `/v3/projects/46c908b76a594588af4bf264b799505c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:12.135234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 943/1872] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:12.136136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27446-f094-4576-bcba-2fd4b5363eb0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:12.138551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c908b76a594588af4bf264b799505c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:12.138681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-33d27446-f094-4576-bcba-2fd4b5363eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:12.140723 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:12.166597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27446-f094-4576-bcba-2fd4b5363eb0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:12.179617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:12.180581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:12.180859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:12.181128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] PATH_INFO: `/v3/users/71278729f1804fbe96b2709d4023f238` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:12.182546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71278729f1804fbe96b2709d4023f238)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:12.184796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:12.257953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c908b76a594588af4bf264b799505c', 'request_id': 'req-6842fca2-9997-49fe-bea9-e820677df144'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.283849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c908b76a594588af4bf264b799505c', 'request_id': 'req-6842fca2-9997-49fe-bea9-e820677df144'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.304575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c908b76a594588af4bf264b799505c', 'request_id': 'req-6842fca2-9997-49fe-bea9-e820677df144'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.310243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71278729f1804fbe96b2709d4023f238'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.331278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] The token cache is being invalidate because project 46c908b76a594588af4bf264b799505c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:12.332070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.333187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.339125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 930/1873] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:11 2022] DELETE /identity/v3/projects/46c908b76a594588af4bf264b799505c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:12.339125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:12.342623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:12.344465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71278729f1804fbe96b2709d4023f238'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.345410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71278729f1804fbe96b2709d4023f238'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.357378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71278729f1804fbe96b2709d4023f238'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.358527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71278729f1804fbe96b2709d4023f238'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.382066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 944/1874] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:12 2022] DELETE /identity/v3/users/71278729f1804fbe96b2709d4023f238 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:12.384356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:12.387652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:12.461442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fca2-9997-49fe-bea9-e820677df144 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:12.470901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:12.493805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc70494-5f6f-4ede-964e-53e518c2d554 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:12.500234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:12.501513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:12.502065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:12.502423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] PATH_INFO: `/v3/users/222755917dad4b149abef7b19664888b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:12.505649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] RBAC: Authorizing `identity:delete_user(user_id=222755917dad4b149abef7b19664888b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:12.510124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:12.534281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:12.567444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20569451-ea32-4e06-92fc-3f44071809ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:12.569102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569451-ea32-4e06-92fc-3f44071809ec admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:12.569614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569451-ea32-4e06-92fc-3f44071809ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:12.570098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569451-ea32-4e06-92fc-3f44071809ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:12.571126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569451-ea32-4e06-92fc-3f44071809ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:12.574330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569451-ea32-4e06-92fc-3f44071809ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:12.620394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 931/1875] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:12 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:12.620394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de623-1b3d-46fe-b34d-479f41bab67b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:12.620394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de623-1b3d-46fe-b34d-479f41bab67b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:12.620995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de623-1b3d-46fe-b34d-479f41bab67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:12.625059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222755917dad4b149abef7b19664888b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.648655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-642de623-1b3d-46fe-b34d-479f41bab67b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:12.652168 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-642de623-1b3d-46fe-b34d-479f41bab67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:12.658811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222755917dad4b149abef7b19664888b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.661420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222755917dad4b149abef7b19664888b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.681916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222755917dad4b149abef7b19664888b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.683017 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222755917dad4b149abef7b19664888b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:12.727751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 945/1876] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:12 2022] DELETE /identity/v3/users/222755917dad4b149abef7b19664888b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:12.730075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:12.733064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:12.804121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 932/1877] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:12.816497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642de623-1b3d-46fe-b34d-479f41bab67b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:12.818073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-642de623-1b3d-46fe-b34d-479f41bab67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:12.968904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623200-a79f-4009-ab9f-d062dea269be admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:12.977519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967e321-837f-4d81-b673-5495deb5ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:12.979162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967e321-837f-4d81-b673-5495deb5ed47 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:12.979512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642de623-1b3d-46fe-b34d-479f41bab67b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:12.979888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967e321-837f-4d81-b673-5495deb5ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:12.980677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967e321-837f-4d81-b673-5495deb5ed47 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:12.982244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967e321-837f-4d81-b673-5495deb5ed47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:12.985341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967e321-837f-4d81-b673-5495deb5ed47 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:13.047830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 946/1878] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:12 2022] POST /identity/v3/users => generated 299 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:13.054231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967e321-837f-4d81-b673-5495deb5ed47 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:13.084853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967e321-837f-4d81-b673-5495deb5ed47 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:13.101909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ed1fe-91fc-42f3-8826-42e89a46f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:13.102874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed1fe-91fc-42f3-8826-42e89a46f223 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.103226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed1fe-91fc-42f3-8826-42e89a46f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.103546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed1fe-91fc-42f3-8826-42e89a46f223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:13.104420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ed1fe-91fc-42f3-8826-42e89a46f223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:13.110615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ed1fe-91fc-42f3-8826-42e89a46f223 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:13.140604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 947/1879] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:13.146189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ed1fe-91fc-42f3-8826-42e89a46f223 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:13.153665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:13.154692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.155232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.155716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:13.170076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ed1fe-91fc-42f3-8826-42e89a46f223 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:13.178593 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b743d-fdac-415f-8e31-4baab5e8e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:13.180595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b743d-fdac-415f-8e31-4baab5e8e72f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.186999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b743d-fdac-415f-8e31-4baab5e8e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.187347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b743d-fdac-415f-8e31-4baab5e8e72f admin admin] PATH_INFO: `/v3/projects/3337de67d17d4fcd9a1944dc07b0f7c5/users/898613d2deba48d88896b774e9618c96/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:13.208370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b743d-fdac-415f-8e31-4baab5e8e72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3337de67d17d4fcd9a1944dc07b0f7c5, user_id=898613d2deba48d88896b774e9618c96, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:13.225505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:13.226953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b743d-fdac-415f-8e31-4baab5e8e72f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:13.228145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:13.278031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 948/1880] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:13 2022] PUT /identity/v3/projects/3337de67d17d4fcd9a1944dc07b0f7c5/users/898613d2deba48d88896b774e9618c96/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:29:13.291520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 933/1881] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:13.293671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b743d-fdac-415f-8e31-4baab5e8e72f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:13.423204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:13.554179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b743d-fdac-415f-8e31-4baab5e8e72f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:13.583526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d14-cfdf-4ced-840d-ad8747324ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:13.584905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d14-cfdf-4ced-840d-ad8747324ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.585463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d14-cfdf-4ced-840d-ad8747324ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.586034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504d14-cfdf-4ced-840d-ad8747324ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:13.587592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504d14-cfdf-4ced-840d-ad8747324ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:13.591348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504d14-cfdf-4ced-840d-ad8747324ec4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:13.593361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:13.595856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:13.630012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51d2d1-6f9e-48d7-9a09-c1a37d8624e5 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:13.643031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 949/1882] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:13.644346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:13.645250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.645527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.645800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] PATH_INFO: `/v3/projects/91229ab5789545e6891c9f73e4d9d5f3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:13.647144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91229ab5789545e6891c9f73e4d9d5f3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:13.647737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d14-cfdf-4ced-840d-ad8747324ec4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:13.650371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:13.673405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504d14-cfdf-4ced-840d-ad8747324ec4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:13.686474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabccfd5-14aa-4656-b87e-c4de27ce8447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:13.688053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabccfd5-14aa-4656-b87e-c4de27ce8447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.688590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabccfd5-14aa-4656-b87e-c4de27ce8447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.689270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabccfd5-14aa-4656-b87e-c4de27ce8447 admin admin] PATH_INFO: `/v3/projects/3337de67d17d4fcd9a1944dc07b0f7c5/users/898613d2deba48d88896b774e9618c96/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:13.695710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabccfd5-14aa-4656-b87e-c4de27ce8447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3337de67d17d4fcd9a1944dc07b0f7c5, user_id=898613d2deba48d88896b774e9618c96, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:13.701478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabccfd5-14aa-4656-b87e-c4de27ce8447 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:13.722297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:13.732505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 950/1883] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:13 2022] PUT /identity/v3/projects/3337de67d17d4fcd9a1944dc07b0f7c5/users/898613d2deba48d88896b774e9618c96/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:13.745159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf78da-96dd-43f2-bea8-4f0277e7d126 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.745159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf78da-96dd-43f2-bea8-4f0277e7d126 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.745159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf78da-96dd-43f2-bea8-4f0277e7d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:13.769916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91229ab5789545e6891c9f73e4d9d5f3', 'request_id': 'req-8b455cfc-3486-42fc-b243-a16566307f48'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:13.787603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91229ab5789545e6891c9f73e4d9d5f3', 'request_id': 'req-8b455cfc-3486-42fc-b243-a16566307f48'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:13.796602 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91229ab5789545e6891c9f73e4d9d5f3', 'request_id': 'req-8b455cfc-3486-42fc-b243-a16566307f48'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:13.810127 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-54cf78da-96dd-43f2-bea8-4f0277e7d126 None None] MFA Rules not processed for user `898613d2deba48d88896b774e9618c96`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:13.810517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] The token cache is being invalidate because project 91229ab5789545e6891c9f73e4d9d5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:13.811011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:13.811657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b455cfc-3486-42fc-b243-a16566307f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:13.812681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-54cf78da-96dd-43f2-bea8-4f0277e7d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:13.813864 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 934/1884] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:13 2022] DELETE /identity/v3/projects/91229ab5789545e6891c9f73e4d9d5f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:29:13.819700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381ef4-738c-41d7-97e0-6d938bc713c7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.820757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381ef4-738c-41d7-97e0-6d938bc713c7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.821783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381ef4-738c-41d7-97e0-6d938bc713c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:13.847501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d5381ef4-738c-41d7-97e0-6d938bc713c7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:13.849087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d5381ef4-738c-41d7-97e0-6d938bc713c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:13.955988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 951/1885] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:29:13.956774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf78da-96dd-43f2-bea8-4f0277e7d126 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:13.958180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-54cf78da-96dd-43f2-bea8-4f0277e7d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:13.975177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 935/1886] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:13.976150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381ef4-738c-41d7-97e0-6d938bc713c7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:13.977659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d5381ef4-738c-41d7-97e0-6d938bc713c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:13.990851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381ef4-738c-41d7-97e0-6d938bc713c7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:13.996850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:13.998111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:13.998417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:13.998674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] PATH_INFO: `/v3/users/73d641511ee544b8a5bd055143154b1e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.000102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d641511ee544b8a5bd055143154b1e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:14.002088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:14.035515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf78da-96dd-43f2-bea8-4f0277e7d126 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:14.041026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:14.042155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.042434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.042702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] PATH_INFO: `/v3/projects/a4ffc305d1d04700b6acae5964c9f040` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.044281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ffc305d1d04700b6acae5964c9f040)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:14.046181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:14.083497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d641511ee544b8a5bd055143154b1e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.109504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:14.114452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d641511ee544b8a5bd055143154b1e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.115535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d641511ee544b8a5bd055143154b1e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.120002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d641511ee544b8a5bd055143154b1e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.132159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ffc305d1d04700b6acae5964c9f040', 'request_id': 'req-2ec1aa97-1c33-493a-b5a0-258d433b35ec'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.137824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d641511ee544b8a5bd055143154b1e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.148089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ffc305d1d04700b6acae5964c9f040', 'request_id': 'req-2ec1aa97-1c33-493a-b5a0-258d433b35ec'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.156859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ffc305d1d04700b6acae5964c9f040', 'request_id': 'req-2ec1aa97-1c33-493a-b5a0-258d433b35ec'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.162898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 936/1887] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:13 2022] DELETE /identity/v3/users/73d641511ee544b8a5bd055143154b1e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:14.163897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:14.166027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.173212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] The token cache is being invalidate because project a4ffc305d1d04700b6acae5964c9f040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:14.173503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.174712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2ec1aa97-1c33-493a-b5a0-258d433b35ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.176274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 952/1888] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:13 2022] DELETE /identity/v3/projects/a4ffc305d1d04700b6acae5964c9f040 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:14.177660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42863a4f-039d-40e8-baf0-526ba7692581 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.178124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42863a4f-039d-40e8-baf0-526ba7692581 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.178296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42863a4f-039d-40e8-baf0-526ba7692581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.209533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:14.211096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-42863a4f-039d-40e8-baf0-526ba7692581 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:14.211096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-42863a4f-039d-40e8-baf0-526ba7692581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.264474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ff3be-ef94-4bfe-a4d5-22a4a61f06ec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:14.269721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:14.270400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.270681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.271326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.273487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.297435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 953/1889] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:14.297435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be072e1-1728-47c1-aacb-1923c42c0931 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.297435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be072e1-1728-47c1-aacb-1923c42c0931 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.297435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be072e1-1728-47c1-aacb-1923c42c0931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.320725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0be072e1-1728-47c1-aacb-1923c42c0931 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:14.322023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0be072e1-1728-47c1-aacb-1923c42c0931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.331861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 954/1890] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:14.332558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be072e1-1728-47c1-aacb-1923c42c0931 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:14.336679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0be072e1-1728-47c1-aacb-1923c42c0931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.355064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be072e1-1728-47c1-aacb-1923c42c0931 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:14.361771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:14.363529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.364451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:14.364565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.364971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] PATH_INFO: `/v3/users/1d1686bf559a4e279c05bc2f5666e178` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.366779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1686bf559a4e279c05bc2f5666e178)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:14.366895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:14.368933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:14.390036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 937/1891] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:14.391689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:14.413424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30222395-0f85-4bcb-b561-2117c6d9d3dd service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:14.422367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:14.423464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.423903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.424466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.426048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:14.426739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:14.429430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:14.445436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 938/1892] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:14.446375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:14.449167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.457256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1686bf559a4e279c05bc2f5666e178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.476283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1686bf559a4e279c05bc2f5666e178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.479818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1686bf559a4e279c05bc2f5666e178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.516962 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1686bf559a4e279c05bc2f5666e178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.521742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1686bf559a4e279c05bc2f5666e178'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:14.546389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 955/1893] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:14 2022] DELETE /identity/v3/users/1d1686bf559a4e279c05bc2f5666e178 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:14.546986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:14.550402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.581600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f06f0-85e6-40dc-bccb-2f9c1a65dcd3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:14.605750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:14.670343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f8d29-44cb-446a-b301-c0b0f252520f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:14.676676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:14.677464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.677754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.678035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.678892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:14.681269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:14.727863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:14.728695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.729041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.729268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.731551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.753823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 956/1894] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:14 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:14.753823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:14.757292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:14.761164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:14.762309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:14.774785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 939/1895] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:14.776289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:14.789045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c60a2-ccb6-48ed-9ac0-e5f9b3159b36 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:14.828748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:14.964556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac87e20-7916-42b4-a8df-c79e1c91adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:14.965935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac87e20-7916-42b4-a8df-c79e1c91adeb admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.968305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac87e20-7916-42b4-a8df-c79e1c91adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.970116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac87e20-7916-42b4-a8df-c79e1c91adeb admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:14.972737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac87e20-7916-42b4-a8df-c79e1c91adeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:14.976027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964d329-06e2-4d47-be42-05520f74bb13 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:14.981109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac87e20-7916-42b4-a8df-c79e1c91adeb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:14.986672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:14.987969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:14.988552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:14.989024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] PATH_INFO: `/v3/users/d200bf295217427f84888a9c112ccbb2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.001889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d200bf295217427f84888a9c112ccbb2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:15.014485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:15.078354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 940/1896] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:14 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:15.081620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac87e20-7916-42b4-a8df-c79e1c91adeb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:15.128895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd200bf295217427f84888a9c112ccbb2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.137123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac87e20-7916-42b4-a8df-c79e1c91adeb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:15.146861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd200bf295217427f84888a9c112ccbb2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.148032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd200bf295217427f84888a9c112ccbb2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.154055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:15.155432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:15.158853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:15.159874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.162408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd200bf295217427f84888a9c112ccbb2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.162629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-154e978b-ac67-437d-8e10-08d8f5f42726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd200bf295217427f84888a9c112ccbb2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.164293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:15.173354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:15.185526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 957/1897] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:14 2022] DELETE /identity/v3/users/d200bf295217427f84888a9c112ccbb2 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:15.192979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b7a20-7f90-4207-93cb-078d9153ae89 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:15.195463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b7a20-7f90-4207-93cb-078d9153ae89 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:15.196230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b7a20-7f90-4207-93cb-078d9153ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.224537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 941/1898] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:15.233098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:15.236984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:15.261603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72190d10-5bdc-474b-bf9f-5ce4a65e5af6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:15.265368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-712b7a20-7f90-4207-93cb-078d9153ae89 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:15.266126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-712b7a20-7f90-4207-93cb-078d9153ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:15.317335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:15.404081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 958/1899] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:15.406792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b7a20-7f90-4207-93cb-078d9153ae89 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:15.416237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-712b7a20-7f90-4207-93cb-078d9153ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:15.451372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b7a20-7f90-4207-93cb-078d9153ae89 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:15.457466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:15.459095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:15.459379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:15.459704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] PATH_INFO: `/v3/projects/bd4de713a54f487cbfe023dabec47948` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.461235 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4de713a54f487cbfe023dabec47948)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:15.463522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:15.485178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:15.488459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:15.490246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:15.491887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.495625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:15.502513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:15.538752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4de713a54f487cbfe023dabec47948', 'request_id': 'req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.549623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 942/1900] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:15.550640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:15.556564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:15.560685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4de713a54f487cbfe023dabec47948', 'request_id': 'req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.584312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4de713a54f487cbfe023dabec47948', 'request_id': 'req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.626671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] The token cache is being invalidate because project bd4de713a54f487cbfe023dabec47948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:15.627052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.627756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c5f9ea76-9be4-4d51-9bf1-f48ce30bcfe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:15.630351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 959/1901] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:15 2022] DELETE /identity/v3/projects/bd4de713a54f487cbfe023dabec47948 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:15.632781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fe37-314c-4b53-9d71-2d9aa7b08966 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:15.633075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fe37-314c-4b53-9d71-2d9aa7b08966 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:15.633355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fe37-314c-4b53-9d71-2d9aa7b08966 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.635203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 960/1902] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:29:15.637702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fe37-314c-4b53-9d71-2d9aa7b08966 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:15.641531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3f90fe37-314c-4b53-9d71-2d9aa7b08966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:15.703194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6a46-7be9-495e-af04-7d6f52f44850 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:15.771044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab240ef-af96-40ee-90d4-a24b4c2dcfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:15.771719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab240ef-af96-40ee-90d4-a24b4c2dcfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:15.772045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab240ef-af96-40ee-90d4-a24b4c2dcfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:15.772373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab240ef-af96-40ee-90d4-a24b4c2dcfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.774426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ab240ef-af96-40ee-90d4-a24b4c2dcfd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:15.788802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:15.817114 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fe37-314c-4b53-9d71-2d9aa7b08966 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:15.829794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:15.830664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:15.831126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:15.831551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] PATH_INFO: `/v3/projects/0ba8c989b87b46a49ba4b911803e33ce/users/959c3a711c394cbcb59da0289e16e887/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.870335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba8c989b87b46a49ba4b911803e33ce, user_id=959c3a711c394cbcb59da0289e16e887, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:15.876146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:15.904743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 961/1903] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:15 2022] PUT /identity/v3/projects/0ba8c989b87b46a49ba4b911803e33ce/users/959c3a711c394cbcb59da0289e16e887/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:15.904743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:15.904743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:15.905112 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab240ef-af96-40ee-90d4-a24b4c2dcfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:15.906933 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab240ef-af96-40ee-90d4-a24b4c2dcfd6 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:15.920273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 943/1904] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:15.922210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69303c16-cdd7-496a-b803-8d126567da4d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:15.922671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69303c16-cdd7-496a-b803-8d126567da4d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:15.923189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69303c16-cdd7-496a-b803-8d126567da4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:15.949599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-69303c16-cdd7-496a-b803-8d126567da4d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:15.951067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-69303c16-cdd7-496a-b803-8d126567da4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:15.972071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:16.010693 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1a243-bed2-40fe-804e-779f30a4fa6e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:16.018476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:16.019389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.019673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.020000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] PATH_INFO: `/v3/projects/1fc629a24f99430a90c6159cdce3109a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.022293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc629a24f99430a90c6159cdce3109a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:16.024464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:16.062006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 944/1905] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:16.065395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecd02b-60eb-4535-bfc2-7d9bb4117f32 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.065900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecd02b-60eb-4535-bfc2-7d9bb4117f32 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.066390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecd02b-60eb-4535-bfc2-7d9bb4117f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.090645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-eaecd02b-60eb-4535-bfc2-7d9bb4117f32 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:16.091985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-eaecd02b-60eb-4535-bfc2-7d9bb4117f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.108978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc629a24f99430a90c6159cdce3109a', 'request_id': 'req-b6c6044c-4c2e-4204-a312-8a47ff425a7d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.119898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc629a24f99430a90c6159cdce3109a', 'request_id': 'req-b6c6044c-4c2e-4204-a312-8a47ff425a7d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.129991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc629a24f99430a90c6159cdce3109a', 'request_id': 'req-b6c6044c-4c2e-4204-a312-8a47ff425a7d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.149153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] The token cache is being invalidate because project 1fc629a24f99430a90c6159cdce3109a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:16.149499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.150210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.155952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 962/1906] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:15 2022] DELETE /identity/v3/projects/1fc629a24f99430a90c6159cdce3109a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:16.157445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:16.159725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.196781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 945/1907] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:16.207081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263cae-c980-4fa4-abce-8d57abd76dd2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.207735 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263cae-c980-4fa4-abce-8d57abd76dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.208298 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263cae-c980-4fa4-abce-8d57abd76dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.249877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6044c-4c2e-4204-a312-8a47ff425a7d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:16.259558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:16.261658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.262157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.262646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] PATH_INFO: `/v3/users/0fa41a92f5514d7590c71cc5e7f121f7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.262752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-57263cae-c980-4fa4-abce-8d57abd76dd2 None None] MFA Rules not processed for user `959c3a711c394cbcb59da0289e16e887`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:16.265071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa41a92f5514d7590c71cc5e7f121f7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:16.265233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-57263cae-c980-4fa4-abce-8d57abd76dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.268443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:16.333216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:16.339231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa41a92f5514d7590c71cc5e7f121f7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.358873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa41a92f5514d7590c71cc5e7f121f7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.359721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa41a92f5514d7590c71cc5e7f121f7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.368639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa41a92f5514d7590c71cc5e7f121f7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.370514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6f512416-4be3-4971-b530-a0974127d6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa41a92f5514d7590c71cc5e7f121f7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.374759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:16.398567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 963/1908] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:16 2022] DELETE /identity/v3/users/0fa41a92f5514d7590c71cc5e7f121f7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:16.402226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b77db-7672-4f1e-8f03-39b8ec90c9f8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.402762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b77db-7672-4f1e-8f03-39b8ec90c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.403221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b77db-7672-4f1e-8f03-39b8ec90c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.411072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 946/1909] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:16.412634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263cae-c980-4fa4-abce-8d57abd76dd2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:16.415255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-57263cae-c980-4fa4-abce-8d57abd76dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.434253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263cae-c980-4fa4-abce-8d57abd76dd2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:16.437006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b27b77db-7672-4f1e-8f03-39b8ec90c9f8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:16.438493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b27b77db-7672-4f1e-8f03-39b8ec90c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.526344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 964/1910] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:16.527414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b77db-7672-4f1e-8f03-39b8ec90c9f8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:16.528978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b27b77db-7672-4f1e-8f03-39b8ec90c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.548196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:16.549626 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.550023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.550425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] PATH_INFO: `/v3/users/dde73c37e6f6410aae7f68bf9c712ad9` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.552443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde73c37e6f6410aae7f68bf9c712ad9)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:16.554900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:16.607274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde73c37e6f6410aae7f68bf9c712ad9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.617653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b77db-7672-4f1e-8f03-39b8ec90c9f8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:16.624852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca5480-7724-4a95-86ae-7956ca7b3103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:16.625413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde73c37e6f6410aae7f68bf9c712ad9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.625540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5480-7724-4a95-86ae-7956ca7b3103 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.625809 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5480-7724-4a95-86ae-7956ca7b3103 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.626083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca5480-7724-4a95-86ae-7956ca7b3103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.626340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde73c37e6f6410aae7f68bf9c712ad9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.627087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde73c37e6f6410aae7f68bf9c712ad9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.627973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5cca5480-7724-4a95-86ae-7956ca7b3103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.636453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde73c37e6f6410aae7f68bf9c712ad9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.641011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca5480-7724-4a95-86ae-7956ca7b3103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:16.642838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca5480-7724-4a95-86ae-7956ca7b3103 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:16.655389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 947/1911] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:16 2022] DELETE /identity/v3/users/dde73c37e6f6410aae7f68bf9c712ad9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:16.656257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:16.657834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.661694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 965/1912] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:16.664941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11bb6-ec56-4191-8129-6da46a024bdb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.666302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11bb6-ec56-4191-8129-6da46a024bdb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.666735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11bb6-ec56-4191-8129-6da46a024bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.700974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-99e11bb6-ec56-4191-8129-6da46a024bdb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:16.702323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-99e11bb6-ec56-4191-8129-6da46a024bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.727408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:16.761347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505b4f3-e4e7-434d-8c31-c2a85c4b3c82 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:16.773010 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:16.773914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.774250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.774513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] PATH_INFO: `/v3/projects/2cfb2a274e104f2a9776139bd1a8c12e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.775934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfb2a274e104f2a9776139bd1a8c12e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:16.780500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:16.853927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 966/1913] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:16.855048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e11bb6-ec56-4191-8129-6da46a024bdb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:16.856801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-99e11bb6-ec56-4191-8129-6da46a024bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.877585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e11bb6-ec56-4191-8129-6da46a024bdb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:16.895415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:16.897166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:16.897452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:16.897728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:16.899395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:16.908411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:16.929826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfb2a274e104f2a9776139bd1a8c12e', 'request_id': 'req-75a9364e-59d7-459e-a1ee-d740370c9be7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.945302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:16.949319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfb2a274e104f2a9776139bd1a8c12e', 'request_id': 'req-75a9364e-59d7-459e-a1ee-d740370c9be7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.965115 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfb2a274e104f2a9776139bd1a8c12e', 'request_id': 'req-75a9364e-59d7-459e-a1ee-d740370c9be7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.983621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] The token cache is being invalidate because project 2cfb2a274e104f2a9776139bd1a8c12e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:16.983621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.983865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 967/1914] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:16 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:16.983942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:16.984032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:16.986681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 948/1915] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:16 2022] DELETE /identity/v3/projects/2cfb2a274e104f2a9776139bd1a8c12e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:16.986820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:16.987642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:16.989345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.100599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9364e-59d7-459e-a1ee-d740370c9be7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.130186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce58ee5-ca63-4d21-865d-797660a446a2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.135460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.136324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.136616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.136896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.137703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:17.140102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.143211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.164236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.164900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.165192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.165437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.165840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 968/1916] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:17.167519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.167716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:17.169697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.181955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.183544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.192517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94302891-2238-468b-9e75-31ad086f13bf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.195578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 949/1917] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:17.196452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:17.198127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.200005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.200777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.201382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.202107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.204551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.211023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.212624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd9327-a915-40af-aa8e-ee8e44dd154c service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.217925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.218895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.219217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.219486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] PATH_INFO: `/v3/users/898613d2deba48d88896b774e9618c96` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.221034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=898613d2deba48d88896b774e9618c96)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.223356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.254178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 969/1918] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:17 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:17.255653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:17.270767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.275249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:17.295629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c56dda-0d92-4e78-8e53-fdd74a669787 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.303529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.303529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.303862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.304856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] PATH_INFO: `/v3/users/c66572716e2e49f8ab208d9be2253123` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.305714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66572716e2e49f8ab208d9be2253123)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.309533 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.311072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898613d2deba48d88896b774e9618c96'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.341035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898613d2deba48d88896b774e9618c96'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.341866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898613d2deba48d88896b774e9618c96'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.343156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898613d2deba48d88896b774e9618c96'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.358984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898613d2deba48d88896b774e9618c96'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.383573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 950/1919] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:17 2022] DELETE /identity/v3/users/898613d2deba48d88896b774e9618c96 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:17.388227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:17.390119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.409988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66572716e2e49f8ab208d9be2253123'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.425423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66572716e2e49f8ab208d9be2253123'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.426603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66572716e2e49f8ab208d9be2253123'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.439585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66572716e2e49f8ab208d9be2253123'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.440610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66572716e2e49f8ab208d9be2253123'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:17.466283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 970/1920] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:17 2022] DELETE /identity/v3/users/c66572716e2e49f8ab208d9be2253123 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:17.472861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:17.476281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.536781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ffb2c-9f9b-4ed4-bac2-49a1463f2214 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.624825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:17.657736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.658776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.659097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.659376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.660856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.663292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.670051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b56182-c636-4371-bd6b-67c9fbef7cb1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.679786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b4517-94e3-4b60-9af0-0a737a5b4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.681262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b4517-94e3-4b60-9af0-0a737a5b4bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.681796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b4517-94e3-4b60-9af0-0a737a5b4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.682506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b4517-94e3-4b60-9af0-0a737a5b4bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.684928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b4517-94e3-4b60-9af0-0a737a5b4bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.690757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b4517-94e3-4b60-9af0-0a737a5b4bd2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.698104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 951/1921] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:17 2022] POST /identity/v3/projects => generated 377 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:17.700480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:17.704035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.715323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 971/1922] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:17.721144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9693bc1-9ba9-40fa-95aa-9fc134725e34 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.721144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9693bc1-9ba9-40fa-95aa-9fc134725e34 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.721578 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9693bc1-9ba9-40fa-95aa-9fc134725e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.748417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e9693bc1-9ba9-40fa-95aa-9fc134725e34 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:17.749656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e9693bc1-9ba9-40fa-95aa-9fc134725e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.822902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:17.870078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a7fe-155c-4391-a2a5-0478671c753d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.879549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.881114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.881564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.882016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] PATH_INFO: `/v3/projects/991e6f7cdad842aaa3d1106573bfb0ad` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.882510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 972/1923] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:17.883958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9693bc1-9ba9-40fa-95aa-9fc134725e34 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:17.886149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e9693bc1-9ba9-40fa-95aa-9fc134725e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:17.889092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991e6f7cdad842aaa3d1106573bfb0ad)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.892628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.906294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9693bc1-9ba9-40fa-95aa-9fc134725e34 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.916106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3ce38-87ac-4cba-a5a3-8462a0e49da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:17.917724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ce38-87ac-4cba-a5a3-8462a0e49da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:17.917724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ce38-87ac-4cba-a5a3-8462a0e49da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:17.917724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ce38-87ac-4cba-a5a3-8462a0e49da9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:17.918046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3ce38-87ac-4cba-a5a3-8462a0e49da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:17.920168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3ce38-87ac-4cba-a5a3-8462a0e49da9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:17.946250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 973/1924] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:17 2022] POST /identity/v3/users => generated 289 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:17.947211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3ce38-87ac-4cba-a5a3-8462a0e49da9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:17.960399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3ce38-87ac-4cba-a5a3-8462a0e49da9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:17.993662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991e6f7cdad842aaa3d1106573bfb0ad', 'request_id': 'req-98e164f0-912f-4c9a-8404-850ac18143a6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.005544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991e6f7cdad842aaa3d1106573bfb0ad', 'request_id': 'req-98e164f0-912f-4c9a-8404-850ac18143a6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.016073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991e6f7cdad842aaa3d1106573bfb0ad', 'request_id': 'req-98e164f0-912f-4c9a-8404-850ac18143a6'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.033078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] The token cache is being invalidate because project 991e6f7cdad842aaa3d1106573bfb0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:18.033406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.034069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.035799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 952/1925] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:17 2022] DELETE /identity/v3/projects/991e6f7cdad842aaa3d1106573bfb0ad => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:18.036806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.038350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.041318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.042682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.043064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.043452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] PATH_INFO: `/v3/projects/9c4b7f42d4e4486faa167e32d708e622/users/a3d44a529baf49979ee4d302261d3bb3/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.053134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e164f0-912f-4c9a-8404-850ac18143a6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.058109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.059017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.059305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.059571 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] PATH_INFO: `/v3/projects/784cb700e18247c78ef318d8eb80f8be` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.061519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784cb700e18247c78ef318d8eb80f8be)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.064390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.078083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4b7f42d4e4486faa167e32d708e622, user_id=a3d44a529baf49979ee4d302261d3bb3, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.081056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.107435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 974/1926] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:17 2022] PUT /identity/v3/projects/9c4b7f42d4e4486faa167e32d708e622/users/a3d44a529baf49979ee4d302261d3bb3/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:18.108843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.111374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.132175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784cb700e18247c78ef318d8eb80f8be', 'request_id': 'req-a6fd2c89-011c-479c-b7b7-34051a1d8173'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.141971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784cb700e18247c78ef318d8eb80f8be', 'request_id': 'req-a6fd2c89-011c-479c-b7b7-34051a1d8173'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.148722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784cb700e18247c78ef318d8eb80f8be', 'request_id': 'req-a6fd2c89-011c-479c-b7b7-34051a1d8173'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.163652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] The token cache is being invalidate because project 784cb700e18247c78ef318d8eb80f8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:18.163985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.164600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.166205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 953/1927] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:18 2022] DELETE /identity/v3/projects/784cb700e18247c78ef318d8eb80f8be => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:18.167021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.168518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.188466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:18.196165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cb5d-7359-438d-be0b-297a54210d7d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.249293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:18.263392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4d4d4-dd01-422c-bd53-07295fcc56dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.266891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d4d4-dd01-422c-bd53-07295fcc56dd service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.266891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d4d4-dd01-422c-bd53-07295fcc56dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.266891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d4d4-dd01-422c-bd53-07295fcc56dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.267219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd2c89-011c-479c-b7b7-34051a1d8173 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.271484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-91c4d4d4-dd01-422c-bd53-07295fcc56dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.272108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.272795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.273080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.273404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.274258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.275837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.287607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4d4d4-dd01-422c-bd53-07295fcc56dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.287776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 954/1928] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:18.289134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4d4d4-dd01-422c-bd53-07295fcc56dd service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.290296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.293199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.310426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 975/1929] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:18.311849 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a842e-0999-4d7e-82d6-b5342ebc0fb2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.311984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20858-bd12-4044-a974-9955c2c9abac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.312181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a842e-0999-4d7e-82d6-b5342ebc0fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.312465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a842e-0999-4d7e-82d6-b5342ebc0fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.317788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.319037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.319675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.320255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] PATH_INFO: `/v3/projects/3337de67d17d4fcd9a1944dc07b0f7c5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.321986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3337de67d17d4fcd9a1944dc07b0f7c5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.325239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.339206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-738a842e-0999-4d7e-82d6-b5342ebc0fb2 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:18.342681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-738a842e-0999-4d7e-82d6-b5342ebc0fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.351090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 976/1930] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:18.351698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a842e-0999-4d7e-82d6-b5342ebc0fb2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.353571 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-738a842e-0999-4d7e-82d6-b5342ebc0fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.373556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a842e-0999-4d7e-82d6-b5342ebc0fb2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.394634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.395552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.395966 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.396551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.398156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.400862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.414349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3337de67d17d4fcd9a1944dc07b0f7c5', 'request_id': 'req-f05652fa-b8a8-4e83-a051-9efa4c44e327'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.420299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 977/1931] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:18.421254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.424128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.427440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3337de67d17d4fcd9a1944dc07b0f7c5', 'request_id': 'req-f05652fa-b8a8-4e83-a051-9efa4c44e327'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.437089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3337de67d17d4fcd9a1944dc07b0f7c5', 'request_id': 'req-f05652fa-b8a8-4e83-a051-9efa4c44e327'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.441661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0bd6-0e09-4248-adfc-02b8975afa5d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.455373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] The token cache is being invalidate because project 3337de67d17d4fcd9a1944dc07b0f7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:18.456959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.458227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.461255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 955/1932] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:18 2022] DELETE /identity/v3/projects/3337de67d17d4fcd9a1944dc07b0f7c5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:18.463708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.467840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.544876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.546200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.546671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.547335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] PATH_INFO: `/v3/users/7c2a7b7bf48540a1be15ca2be1122a60` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.550482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2a7b7bf48540a1be15ca2be1122a60)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.552804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.569552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05652fa-b8a8-4e83-a051-9efa4c44e327 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.574921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ddbb-b59e-47d9-b987-13a211142d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.575889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ddbb-b59e-47d9-b987-13a211142d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.576086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ddbb-b59e-47d9-b987-13a211142d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.576215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ddbb-b59e-47d9-b987-13a211142d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.577010 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929ddbb-b59e-47d9-b987-13a211142d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.579684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929ddbb-b59e-47d9-b987-13a211142d79 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.597496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 956/1933] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:18.597496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d55c-5efa-49f4-93c8-6bdb2126dd8d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.597496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d55c-5efa-49f4-93c8-6bdb2126dd8d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.597496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d55c-5efa-49f4-93c8-6bdb2126dd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.628612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-20d8d55c-5efa-49f4-93c8-6bdb2126dd8d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:18.629870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-20d8d55c-5efa-49f4-93c8-6bdb2126dd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.644975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2a7b7bf48540a1be15ca2be1122a60'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.651433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 957/1934] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:18.652446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8d55c-5efa-49f4-93c8-6bdb2126dd8d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.653934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-20d8d55c-5efa-49f4-93c8-6bdb2126dd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.668792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2a7b7bf48540a1be15ca2be1122a60'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.669943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2a7b7bf48540a1be15ca2be1122a60'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.670916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8d55c-5efa-49f4-93c8-6bdb2126dd8d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.680484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2a7b7bf48540a1be15ca2be1122a60'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.681256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1987ba35-fb5d-4b90-a2d8-43a144216ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2a7b7bf48540a1be15ca2be1122a60'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:18.681376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.684511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.685127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.685466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] PATH_INFO: `/v3/projects/9c4b7f42d4e4486faa167e32d708e622/users/a3d44a529baf49979ee4d302261d3bb3/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.690404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4b7f42d4e4486faa167e32d708e622, user_id=a3d44a529baf49979ee4d302261d3bb3, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.694350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.702804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 978/1935] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:18 2022] DELETE /identity/v3/users/7c2a7b7bf48540a1be15ca2be1122a60 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:18.705274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb6aa-0ef2-4b7b-ba53-9c2379c4aab3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.705649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb6aa-0ef2-4b7b-ba53-9c2379c4aab3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.706489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb6aa-0ef2-4b7b-ba53-9c2379c4aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.710038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 958/1936] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:18 2022] PUT /identity/v3/projects/9c4b7f42d4e4486faa167e32d708e622/users/a3d44a529baf49979ee4d302261d3bb3/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:18.711974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.715488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.722116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:18.731182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-67feb6aa-0ef2-4b7b-ba53-9c2379c4aab3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:18.732867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-67feb6aa-0ef2-4b7b-ba53-9c2379c4aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.825924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:18.853617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 979/1937] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:18.855758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb6aa-0ef2-4b7b-ba53-9c2379c4aab3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.857443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-67feb6aa-0ef2-4b7b-ba53-9c2379c4aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:18.877739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96182-b9ba-41b5-a20e-902be240d6c3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.887186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98b79f-3d35-4e03-bece-b3ad09147f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.888755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b79f-3d35-4e03-bece-b3ad09147f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.891542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b79f-3d35-4e03-bece-b3ad09147f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.892097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b79f-3d35-4e03-bece-b3ad09147f44 admin admin] PATH_INFO: `/v3/projects/71dc92359e2a4d3da7c3917ee134bbe8/users/04f15aaf125f4219a07f23c1084f353e/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.909376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb6aa-0ef2-4b7b-ba53-9c2379c4aab3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:18.919107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:18.919986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.920647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.921175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.922438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:18.923166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.927709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.934541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98b79f-3d35-4e03-bece-b3ad09147f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dc92359e2a4d3da7c3917ee134bbe8, user_id=04f15aaf125f4219a07f23c1084f353e, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:18.940412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98b79f-3d35-4e03-bece-b3ad09147f44 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:18.970765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 959/1938] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:18 2022] PUT /identity/v3/projects/71dc92359e2a4d3da7c3917ee134bbe8/users/04f15aaf125f4219a07f23c1084f353e/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:18.972537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83554c-2a29-4588-8a12-29d925fe27dd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:18.972878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83554c-2a29-4588-8a12-29d925fe27dd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:18.973211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83554c-2a29-4588-8a12-29d925fe27dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:18.976898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 980/1939] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:18.978222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:18.994235 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.018511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23df6fb-87ee-431f-8458-50c9cf627e93 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:19.030895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5c83554c-2a29-4588-8a12-29d925fe27dd None None] MFA Rules not processed for user `a3d44a529baf49979ee4d302261d3bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:19.032794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5c83554c-2a29-4588-8a12-29d925fe27dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.207117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 960/1940] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:19.207117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54df6-ca2e-401a-bb8f-baef1bf903c8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.207117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54df6-ca2e-401a-bb8f-baef1bf903c8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.207117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54df6-ca2e-401a-bb8f-baef1bf903c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.228665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:19.229419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bdc54df6-ca2e-401a-bb8f-baef1bf903c8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:19.231608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.231608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.231608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] PATH_INFO: `/v3/projects/679a17081f1d427da91a48e94be36027` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.231900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bdc54df6-ca2e-401a-bb8f-baef1bf903c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.232407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=679a17081f1d427da91a48e94be36027)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:19.234403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:19.248155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 961/1941] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:19.249420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54df6-ca2e-401a-bb8f-baef1bf903c8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:19.263709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54df6-ca2e-401a-bb8f-baef1bf903c8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:19.268937 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1f64-0b1c-454e-9594-893a7c4116ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:19.269660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1f64-0b1c-454e-9594-893a7c4116ef admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.269896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1f64-0b1c-454e-9594-893a7c4116ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.270175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1f64-0b1c-454e-9594-893a7c4116ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.271015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df1f64-0b1c-454e-9594-893a7c4116ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:19.272934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df1f64-0b1c-454e-9594-893a7c4116ef admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:19.306713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679a17081f1d427da91a48e94be36027', 'request_id': 'req-e382eee1-c306-4980-9395-cb158bd5f69a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.308426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 962/1942] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:19 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:19.312614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046008-c9ac-43c3-b6ce-d80a48cc8825 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.312908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046008-c9ac-43c3-b6ce-d80a48cc8825 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.313250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046008-c9ac-43c3-b6ce-d80a48cc8825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.317937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679a17081f1d427da91a48e94be36027', 'request_id': 'req-e382eee1-c306-4980-9395-cb158bd5f69a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.327066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679a17081f1d427da91a48e94be36027', 'request_id': 'req-e382eee1-c306-4980-9395-cb158bd5f69a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.342299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] The token cache is being invalidate because project 679a17081f1d427da91a48e94be36027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:19.342776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.343926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.346567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 981/1943] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:18 2022] DELETE /identity/v3/projects/679a17081f1d427da91a48e94be36027 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:19.347942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:19.350737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.352665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-86046008-c9ac-43c3-b6ce-d80a48cc8825 None None] MFA Rules not processed for user `04f15aaf125f4219a07f23c1084f353e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:19.353960 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-86046008-c9ac-43c3-b6ce-d80a48cc8825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.384357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:19.434178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382eee1-c306-4980-9395-cb158bd5f69a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:19.443584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 963/1944] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:19.444845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046008-c9ac-43c3-b6ce-d80a48cc8825 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:19.446373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-86046008-c9ac-43c3-b6ce-d80a48cc8825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.492886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:19.497810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:19.498642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.499083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.499455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.502124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.590680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046008-c9ac-43c3-b6ce-d80a48cc8825 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:19.598235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:19.599165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.599446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.599718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] PATH_INFO: `/v3/projects/106ee49ecc3643a3ae0efbde1f1e3752` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.605189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106ee49ecc3643a3ae0efbde1f1e3752)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:19.605189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:19.647601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:19.649376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:19.672111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 982/1945] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:19.674236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:19.677383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.687444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106ee49ecc3643a3ae0efbde1f1e3752', 'request_id': 'req-bbf372b5-db27-465b-bcdd-bfae576d0ad4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.718139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106ee49ecc3643a3ae0efbde1f1e3752', 'request_id': 'req-bbf372b5-db27-465b-bcdd-bfae576d0ad4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.722796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4d176-050c-426c-898c-306000409eba service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:19.730896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106ee49ecc3643a3ae0efbde1f1e3752', 'request_id': 'req-bbf372b5-db27-465b-bcdd-bfae576d0ad4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.760396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] The token cache is being invalidate because project 106ee49ecc3643a3ae0efbde1f1e3752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:19.760698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.761375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.766630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 964/1946] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:19 2022] DELETE /identity/v3/projects/106ee49ecc3643a3ae0efbde1f1e3752 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:19.766630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:19.767762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.837002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:19.838001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.838617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.839226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.840010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:19.840348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:19.840721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf372b5-db27-465b-bcdd-bfae576d0ad4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:19.842219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:19.845823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:19.846512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.846823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.847214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.847851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:19.849806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:19.855889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 983/1947] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:19.856798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:19.859547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.878132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452bee-c2cb-4e1c-b0ba-82dbc1563ec5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:19.884205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 965/1948] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:19 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:19.884205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:19.884205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.884891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:19.885837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.886115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.886391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] PATH_INFO: `/v3/users/36487d6d90e24c9b92bcf4fd3f8cc400` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.887738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36487d6d90e24c9b92bcf4fd3f8cc400)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:19.889914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:19.897652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52363-db0a-4cb3-978e-977e7d08813a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:19.904420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4722226-2e39-4d2c-be38-51863df0687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:19.907091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722226-2e39-4d2c-be38-51863df0687d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.907563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722226-2e39-4d2c-be38-51863df0687d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.907967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722226-2e39-4d2c-be38-51863df0687d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.908756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4722226-2e39-4d2c-be38-51863df0687d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:19.912009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4722226-2e39-4d2c-be38-51863df0687d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:19.918847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:19.955783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 966/1949] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:19 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:19.955783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d9d9-b758-4cec-b554-2fd379abd991 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:19.955783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d9d9-b758-4cec-b554-2fd379abd991 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:19.955783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2d9d9-b758-4cec-b554-2fd379abd991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:19.961649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36487d6d90e24c9b92bcf4fd3f8cc400'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.978107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36487d6d90e24c9b92bcf4fd3f8cc400'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.978834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36487d6d90e24c9b92bcf4fd3f8cc400'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.979068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c9f2d9d9-b758-4cec-b554-2fd379abd991 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:19.980430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c9f2d9d9-b758-4cec-b554-2fd379abd991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:19.988500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36487d6d90e24c9b92bcf4fd3f8cc400'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.989227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36487d6d90e24c9b92bcf4fd3f8cc400'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:19.992808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:20.010166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 984/1950] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:19 2022] DELETE /identity/v3/users/36487d6d90e24c9b92bcf4fd3f8cc400 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:20.011076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.014622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.068699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 967/1951] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:20.069566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2d9d9-b758-4cec-b554-2fd379abd991 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.072774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c9f2d9d9-b758-4cec-b554-2fd379abd991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.088577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2d9d9-b758-4cec-b554-2fd379abd991 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.093826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68177b-cb8d-4d16-b4c4-f4ebf251d42e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.099036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.099724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.100011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.100298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.102750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.184480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.185952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.186469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.187332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.187631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.188907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.190388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.190789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.205543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 985/1952] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:20.220721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.222157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.230589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 968/1953] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:20 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:20.232276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.234177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.271827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2733d-eabd-4349-925d-4b5142f6a421 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.345734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc0c4a-a144-4a23-8713-a38899ce6826 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.357290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e956c-d7e0-4edd-a247-b48465331d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.358065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e956c-d7e0-4edd-a247-b48465331d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.358347 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e956c-d7e0-4edd-a247-b48465331d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.359096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e956c-d7e0-4edd-a247-b48465331d14 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.359848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e956c-d7e0-4edd-a247-b48465331d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.363246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e956c-d7e0-4edd-a247-b48465331d14 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.365784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:20.393471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 969/1954] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:20 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:20.393471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a611d-e09e-4dbe-8ced-75649f2fd6b5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.393471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a611d-e09e-4dbe-8ced-75649f2fd6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.393471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a611d-e09e-4dbe-8ced-75649f2fd6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.398544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df15e2d-cee4-4a01-9b33-efff155c0062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.399429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df15e2d-cee4-4a01-9b33-efff155c0062 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.400091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df15e2d-cee4-4a01-9b33-efff155c0062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.400440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df15e2d-cee4-4a01-9b33-efff155c0062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.401330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df15e2d-cee4-4a01-9b33-efff155c0062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.405034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df15e2d-cee4-4a01-9b33-efff155c0062 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.422648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7d9a611d-e09e-4dbe-8ced-75649f2fd6b5 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:20.425562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d9a611d-e09e-4dbe-8ced-75649f2fd6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.429071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 986/1955] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:20.429071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df15e2d-cee4-4a01-9b33-efff155c0062 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.440844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 970/1956] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:20.440844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a611d-e09e-4dbe-8ced-75649f2fd6b5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.451149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a611d-e09e-4dbe-8ced-75649f2fd6b5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.456659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.457353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.457637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.457910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.458720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.460261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df15e2d-cee4-4a01-9b33-efff155c0062 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.460412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.475308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 971/1957] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:20.475308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.476046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.477475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eeb88-21e8-4d40-b6c1-23ce47474ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.480658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eeb88-21e8-4d40-b6c1-23ce47474ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.481089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eeb88-21e8-4d40-b6c1-23ce47474ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.481512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eeb88-21e8-4d40-b6c1-23ce47474ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.483154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eeb88-21e8-4d40-b6c1-23ce47474ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.486204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155eeb88-21e8-4d40-b6c1-23ce47474ce5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.500128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fead8-7359-45dc-8b1f-1dc104cdab51 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.509493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.511076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.511744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.512024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] PATH_INFO: `/v3/projects/9c919c0943ce4040aeb3682962b7618f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.514495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c919c0943ce4040aeb3682962b7618f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.518951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 987/1958] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:20 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:20.518951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eeb88-21e8-4d40-b6c1-23ce47474ce5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.519234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.533925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:20.534324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eeb88-21e8-4d40-b6c1-23ce47474ce5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.552232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60c12-1585-45cb-b064-8eec355ace40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.553013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60c12-1585-45cb-b064-8eec355ace40 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.553272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60c12-1585-45cb-b064-8eec355ace40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.553553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f60c12-1585-45cb-b064-8eec355ace40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.554345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f60c12-1585-45cb-b064-8eec355ace40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.556174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f60c12-1585-45cb-b064-8eec355ace40 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.574942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 988/1959] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:20.574942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60c12-1585-45cb-b064-8eec355ace40 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.584719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f60c12-1585-45cb-b064-8eec355ace40 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.590588 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.591428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.591727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.591984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.592735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:20.593361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.595543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.619722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 989/1960] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:20.622146 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c919c0943ce4040aeb3682962b7618f', 'request_id': 'req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:20.624675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.631753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c919c0943ce4040aeb3682962b7618f', 'request_id': 'req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:20.640436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c919c0943ce4040aeb3682962b7618f', 'request_id': 'req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:20.640720 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcd0ae-9206-4175-ae41-b419e401f4a7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.676986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] The token cache is being invalidate because project 9c919c0943ce4040aeb3682962b7618f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:20.676986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:20.678949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:20.686135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 972/1961] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:20 2022] DELETE /identity/v3/projects/9c919c0943ce4040aeb3682962b7618f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:20.686135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.688343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.737413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.738263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.738550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.739424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] PATH_INFO: `/v3/projects/ed90247ed3d04bc7b5f8d50c06cd8588/users/ccf83bdb08ec4313a4ce11d00729207f/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.768418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed90247ed3d04bc7b5f8d50c06cd8588, user_id=ccf83bdb08ec4313a4ce11d00729207f, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.781967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.813834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 990/1962] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:20 2022] PUT /identity/v3/projects/ed90247ed3d04bc7b5f8d50c06cd8588/users/ccf83bdb08ec4313a4ce11d00729207f/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:20.814690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.818709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:20.861158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30369e-b7e8-4d78-951a-9d2bcd14fd42 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.929085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7ffbc-b750-4c3b-9753-44608c27f71a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:20.945087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bedd2-b819-4551-9335-29a7c5b7326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.951615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bedd2-b819-4551-9335-29a7c5b7326f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.952374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bedd2-b819-4551-9335-29a7c5b7326f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.953167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bedd2-b819-4551-9335-29a7c5b7326f admin admin] PATH_INFO: `/v3/projects/8aee1988a19f4bdf8b1edc804eba4d42/users/f2945b928e14454296983a32987e8c14/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.966531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:20.967402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:20.967709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:20.968545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:20.970362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:20.971223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:20.991369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 973/1963] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:20.993023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:20.995612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:21.009053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bedd2-b819-4551-9335-29a7c5b7326f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aee1988a19f4bdf8b1edc804eba4d42, user_id=f2945b928e14454296983a32987e8c14, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.014139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bedd2-b819-4551-9335-29a7c5b7326f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.019149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e58a5c-0231-4243-9a85-89d486062d5e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.027538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.028622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.029266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.029459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.030651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.036109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.040924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 991/1964] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:20 2022] PUT /identity/v3/projects/8aee1988a19f4bdf8b1edc804eba4d42/users/f2945b928e14454296983a32987e8c14/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:21.042203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175a411-fce7-4559-9b0b-355c2e579185 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.042489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175a411-fce7-4559-9b0b-355c2e579185 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.042774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175a411-fce7-4559-9b0b-355c2e579185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.076355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5175a411-fce7-4559-9b0b-355c2e579185 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:21.077845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5175a411-fce7-4559-9b0b-355c2e579185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:21.085584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 974/1965] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:20 2022] POST /identity/v3/projects => generated 399 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:21.087218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.088303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:21.089617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:21.120003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:21.178292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30d3bd-92c9-4340-8610-90118d4e73a0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.183195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47abcb-74ef-40bd-a650-a6ce507e64be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.183878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47abcb-74ef-40bd-a650-a6ce507e64be admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.184157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47abcb-74ef-40bd-a650-a6ce507e64be admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.184433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47abcb-74ef-40bd-a650-a6ce507e64be admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.185217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47abcb-74ef-40bd-a650-a6ce507e64be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.186887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47abcb-74ef-40bd-a650-a6ce507e64be admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.197681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 992/1966] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:21.197681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175a411-fce7-4559-9b0b-355c2e579185 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.211708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 975/1967] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:21.215125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c928a-51f2-4330-bf0f-372031bc706e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.215942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c928a-51f2-4330-bf0f-372031bc706e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.216092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175a411-fce7-4559-9b0b-355c2e579185 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.216832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c928a-51f2-4330-bf0f-372031bc706e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.227195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c843a-f2a7-4177-884b-8325d78886f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.228037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c843a-f2a7-4177-884b-8325d78886f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.228424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c843a-f2a7-4177-884b-8325d78886f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.228706 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c843a-f2a7-4177-884b-8325d78886f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.229545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c843a-f2a7-4177-884b-8325d78886f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.236475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c843a-f2a7-4177-884b-8325d78886f5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.250781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 993/1968] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:21.252483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fb4c928a-51f2-4330-bf0f-372031bc706e None None] MFA Rules not processed for user `f2945b928e14454296983a32987e8c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:21.253071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c843a-f2a7-4177-884b-8325d78886f5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.253548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fb4c928a-51f2-4330-bf0f-372031bc706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:21.272727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c843a-f2a7-4177-884b-8325d78886f5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.280958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06eab0-e736-4b78-964c-a277883c8cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.281899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06eab0-e736-4b78-964c-a277883c8cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.282321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06eab0-e736-4b78-964c-a277883c8cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.282679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06eab0-e736-4b78-964c-a277883c8cfd admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.283660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06eab0-e736-4b78-964c-a277883c8cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.285757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06eab0-e736-4b78-964c-a277883c8cfd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.308363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 994/1969] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/users => generated 300 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:21.313000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8a3d-9bce-473a-9417-50dc5679cdf6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.313316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8a3d-9bce-473a-9417-50dc5679cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.313554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8a3d-9bce-473a-9417-50dc5679cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.338531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dd1e8a3d-9bce-473a-9417-50dc5679cdf6 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:21.339891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd1e8a3d-9bce-473a-9417-50dc5679cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:21.350453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 995/1970] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:21.351316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8a3d-9bce-473a-9417-50dc5679cdf6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.363527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8a3d-9bce-473a-9417-50dc5679cdf6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.365386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 976/1971] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:21.366992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c928a-51f2-4330-bf0f-372031bc706e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.369096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda57d57-5d21-4a9e-8973-801c26e5ce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.370241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda57d57-5d21-4a9e-8973-801c26e5ce71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.370508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda57d57-5d21-4a9e-8973-801c26e5ce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.370788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda57d57-5d21-4a9e-8973-801c26e5ce71 admin admin] PATH_INFO: `/v3/projects/ed90247ed3d04bc7b5f8d50c06cd8588/users/ccf83bdb08ec4313a4ce11d00729207f/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.373237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda57d57-5d21-4a9e-8973-801c26e5ce71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed90247ed3d04bc7b5f8d50c06cd8588, user_id=ccf83bdb08ec4313a4ce11d00729207f, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.376007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda57d57-5d21-4a9e-8973-801c26e5ce71 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.385487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c928a-51f2-4330-bf0f-372031bc706e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.389791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 996/1972] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:21 2022] PUT /identity/v3/projects/ed90247ed3d04bc7b5f8d50c06cd8588/users/ccf83bdb08ec4313a4ce11d00729207f/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:21.390659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda57d57-5d21-4a9e-8973-801c26e5ce71 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.470231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda57d57-5d21-4a9e-8973-801c26e5ce71 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.471398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1d91-a157-416e-a8dd-40b5eb2e8fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.472327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1d91-a157-416e-a8dd-40b5eb2e8fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.472611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1d91-a157-416e-a8dd-40b5eb2e8fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.472892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1d91-a157-416e-a8dd-40b5eb2e8fd0 admin admin] PATH_INFO: `/v3/projects/5198b71d93eb44e593e7bb28a2a2cca7/users/47eaa64990b6464dbd96a5171edafa9d/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.475575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00deed2-97d0-450d-892e-0ce0188c9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.476268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00deed2-97d0-450d-892e-0ce0188c9288 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.476549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00deed2-97d0-450d-892e-0ce0188c9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.476822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00deed2-97d0-450d-892e-0ce0188c9288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.477566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00deed2-97d0-450d-892e-0ce0188c9288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.479506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00deed2-97d0-450d-892e-0ce0188c9288 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.492729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 997/1973] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:21.493608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00deed2-97d0-450d-892e-0ce0188c9288 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.501221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf1d91-a157-416e-a8dd-40b5eb2e8fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5198b71d93eb44e593e7bb28a2a2cca7, user_id=47eaa64990b6464dbd96a5171edafa9d, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.504303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf1d91-a157-416e-a8dd-40b5eb2e8fd0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.506733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00deed2-97d0-450d-892e-0ce0188c9288 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.515162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415680ac-773b-4cbc-98bc-8e71afb065eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.516258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415680ac-773b-4cbc-98bc-8e71afb065eb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.516660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415680ac-773b-4cbc-98bc-8e71afb065eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.516946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415680ac-773b-4cbc-98bc-8e71afb065eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.517692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415680ac-773b-4cbc-98bc-8e71afb065eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:21.518001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415680ac-773b-4cbc-98bc-8e71afb065eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.519846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415680ac-773b-4cbc-98bc-8e71afb065eb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.521916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 977/1974] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:21 2022] PUT /identity/v3/projects/5198b71d93eb44e593e7bb28a2a2cca7/users/47eaa64990b6464dbd96a5171edafa9d/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:21.522733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1d91-a157-416e-a8dd-40b5eb2e8fd0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.548534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 998/1975] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:21.550370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87c3c5-a580-485f-a856-3e4ead5e0fc7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.550736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87c3c5-a580-485f-a856-3e4ead5e0fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.551099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87c3c5-a580-485f-a856-3e4ead5e0fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.564227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:21.582293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1c87c3c5-a580-485f-a856-3e4ead5e0fc7 None None] MFA Rules not processed for user `ccf83bdb08ec4313a4ce11d00729207f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:21.583604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c87c3c5-a580-485f-a856-3e4ead5e0fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:21.601314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1d91-a157-416e-a8dd-40b5eb2e8fd0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.609474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d19d-df8d-4886-b15a-9d8de6ef872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.609474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d19d-df8d-4886-b15a-9d8de6ef872f admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.609474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d19d-df8d-4886-b15a-9d8de6ef872f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.609936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d19d-df8d-4886-b15a-9d8de6ef872f admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.610823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724d19d-df8d-4886-b15a-9d8de6ef872f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.614172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724d19d-df8d-4886-b15a-9d8de6ef872f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.634256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:21.657249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 978/1976] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:21.657249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d19d-df8d-4886-b15a-9d8de6ef872f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.682997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 999/1977] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:21.684373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a543b-ae28-4bff-8836-63d04c7f812d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.684646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a543b-ae28-4bff-8836-63d04c7f812d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.684925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a543b-ae28-4bff-8836-63d04c7f812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.712515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-361a543b-ae28-4bff-8836-63d04c7f812d None None] MFA Rules not processed for user `47eaa64990b6464dbd96a5171edafa9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:21.713803 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-361a543b-ae28-4bff-8836-63d04c7f812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:21.726343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d19d-df8d-4886-b15a-9d8de6ef872f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.731020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41f268-2390-46d7-aaab-cab4cbcc1726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.732107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f268-2390-46d7-aaab-cab4cbcc1726 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.732412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f268-2390-46d7-aaab-cab4cbcc1726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.732690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f268-2390-46d7-aaab-cab4cbcc1726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.733451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41f268-2390-46d7-aaab-cab4cbcc1726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.735130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41f268-2390-46d7-aaab-cab4cbcc1726 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.749741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 979/1978] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:21.753164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41f268-2390-46d7-aaab-cab4cbcc1726 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.761410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41f268-2390-46d7-aaab-cab4cbcc1726 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.766542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.767243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.767531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.767914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.768699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.770770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.789357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1000/1979] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:21.792013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a543b-ae28-4bff-8836-63d04c7f812d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.804732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 980/1980] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:21.805787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.808214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a543b-ae28-4bff-8836-63d04c7f812d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.808416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:21.897094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ea0b-abf3-44e4-97a9-49e54ae9e8e4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.903011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230307d4-8de0-4253-bd97-5fc0266e448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.903754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230307d4-8de0-4253-bd97-5fc0266e448e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.904040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230307d4-8de0-4253-bd97-5fc0266e448e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.904313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230307d4-8de0-4253-bd97-5fc0266e448e admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.904624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d9b3-89dc-48e7-b1d2-2b5d77e95d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.905071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230307d4-8de0-4253-bd97-5fc0266e448e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.905817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d9b3-89dc-48e7-b1d2-2b5d77e95d4d service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.906321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d9b3-89dc-48e7-b1d2-2b5d77e95d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.906877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d9b3-89dc-48e7-b1d2-2b5d77e95d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.907278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230307d4-8de0-4253-bd97-5fc0266e448e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:21.941264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1001/1981] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:21 2022] POST /identity/v3/users => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:21.941877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230307d4-8de0-4253-bd97-5fc0266e448e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:21.963655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230307d4-8de0-4253-bd97-5fc0266e448e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:21.970650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f15f3a-e0fd-47c3-bf49-6969b1113e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:21.971614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f15f3a-e0fd-47c3-bf49-6969b1113e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:21.971947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f15f3a-e0fd-47c3-bf49-6969b1113e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:21.972226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f15f3a-e0fd-47c3-bf49-6969b1113e55 admin admin] PATH_INFO: `/v3/projects/c7b67824d1fc4de69c649647473c8c58/users/36d784e5d78845b0a5370712c5ca7746/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:21.987804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:21.992911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f15f3a-e0fd-47c3-bf49-6969b1113e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b67824d1fc4de69c649647473c8c58, user_id=36d784e5d78845b0a5370712c5ca7746, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:21.996645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f15f3a-e0fd-47c3-bf49-6969b1113e55 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.023338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1002/1982] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:21 2022] PUT /identity/v3/projects/c7b67824d1fc4de69c649647473c8c58/users/36d784e5d78845b0a5370712c5ca7746/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:22.023338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f15f3a-e0fd-47c3-bf49-6969b1113e55 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.025044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d9b3-89dc-48e7-b1d2-2b5d77e95d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.028618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d9b3-89dc-48e7-b1d2-2b5d77e95d4d service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.058153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 981/1983] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:22.060823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d9b3-89dc-48e7-b1d2-2b5d77e95d4d service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.071059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:22.078508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d9b3-89dc-48e7-b1d2-2b5d77e95d4d service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.124189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f15f3a-e0fd-47c3-bf49-6969b1113e55 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.132004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82424-631a-463c-a5ea-02478bf4d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.133201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82424-631a-463c-a5ea-02478bf4d3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.133464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82424-631a-463c-a5ea-02478bf4d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.133746 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82424-631a-463c-a5ea-02478bf4d3a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.134487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82424-631a-463c-a5ea-02478bf4d3a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.141933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82424-631a-463c-a5ea-02478bf4d3a0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.156320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbac3e-ef6d-4fdc-8ad4-a61bf3686c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.157074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbac3e-ef6d-4fdc-8ad4-a61bf3686c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.157352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbac3e-ef6d-4fdc-8ad4-a61bf3686c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.157630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbac3e-ef6d-4fdc-8ad4-a61bf3686c8b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.158530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbac3e-ef6d-4fdc-8ad4-a61bf3686c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.160868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbac3e-ef6d-4fdc-8ad4-a61bf3686c8b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.178915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1003/1984] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:22 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:22.180078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82424-631a-463c-a5ea-02478bf4d3a0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.193891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 982/1985] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:22 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:22.195310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef273c6-97fb-4a1e-9aa1-d3e1628e04ed None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.195647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef273c6-97fb-4a1e-9aa1-d3e1628e04ed None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.195909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef273c6-97fb-4a1e-9aa1-d3e1628e04ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.243755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1ef273c6-97fb-4a1e-9aa1-d3e1628e04ed None None] MFA Rules not processed for user `36d784e5d78845b0a5370712c5ca7746`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:22.247911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ef273c6-97fb-4a1e-9aa1-d3e1628e04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:22.320548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82424-631a-463c-a5ea-02478bf4d3a0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.327054 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fce486-42f4-46fc-bca8-9ce132cf6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.327851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fce486-42f4-46fc-bca8-9ce132cf6953 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.328241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fce486-42f4-46fc-bca8-9ce132cf6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.328933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fce486-42f4-46fc-bca8-9ce132cf6953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.329643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fce486-42f4-46fc-bca8-9ce132cf6953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.331985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fce486-42f4-46fc-bca8-9ce132cf6953 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.346805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1004/1986] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:22.348030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fce486-42f4-46fc-bca8-9ce132cf6953 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.391657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fce486-42f4-46fc-bca8-9ce132cf6953 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.406028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 983/1987] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:22.407799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef273c6-97fb-4a1e-9aa1-d3e1628e04ed None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.409602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef060a-6a58-4e71-b311-a6b76e400557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.410494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef060a-6a58-4e71-b311-a6b76e400557 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.410906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef060a-6a58-4e71-b311-a6b76e400557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.411296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef060a-6a58-4e71-b311-a6b76e400557 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.412309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef060a-6a58-4e71-b311-a6b76e400557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.414678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef060a-6a58-4e71-b311-a6b76e400557 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.432947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef273c6-97fb-4a1e-9aa1-d3e1628e04ed None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.449721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58062266-beec-441e-9a10-872ec64e7784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.451879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062266-beec-441e-9a10-872ec64e7784 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.453441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062266-beec-441e-9a10-872ec64e7784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.455014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062266-beec-441e-9a10-872ec64e7784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.457137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58062266-beec-441e-9a10-872ec64e7784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.460043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58062266-beec-441e-9a10-872ec64e7784 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.465938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1005/1988] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:22 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:22.465938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef060a-6a58-4e71-b311-a6b76e400557 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.478821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef060a-6a58-4e71-b311-a6b76e400557 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.487698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d166e-a8e2-45f4-8d30-f4d3d35e9e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.489039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d166e-a8e2-45f4-8d30-f4d3d35e9e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.489347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d166e-a8e2-45f4-8d30-f4d3d35e9e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.489627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d166e-a8e2-45f4-8d30-f4d3d35e9e2f admin admin] PATH_INFO: `/v3/projects/b5d66794ff89434499520173f1fec935/users/b7495430ae1946aab56ae7635bdd41aa/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.494932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 984/1989] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:22.496752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58062266-beec-441e-9a10-872ec64e7784 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.515625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58062266-beec-441e-9a10-872ec64e7784 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.523481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e3ede-648c-45ec-9fd4-c1a3c53013b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.524492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3ede-648c-45ec-9fd4-c1a3c53013b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.524788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3ede-648c-45ec-9fd4-c1a3c53013b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.525203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3ede-648c-45ec-9fd4-c1a3c53013b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.526120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e3ede-648c-45ec-9fd4-c1a3c53013b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.528834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e3ede-648c-45ec-9fd4-c1a3c53013b4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.532853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d166e-a8e2-45f4-8d30-f4d3d35e9e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d66794ff89434499520173f1fec935, user_id=b7495430ae1946aab56ae7635bdd41aa, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.536547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d166e-a8e2-45f4-8d30-f4d3d35e9e2f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.581149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1006/1990] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:22 2022] PUT /identity/v3/projects/b5d66794ff89434499520173f1fec935/users/b7495430ae1946aab56ae7635bdd41aa/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:22.590154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d166e-a8e2-45f4-8d30-f4d3d35e9e2f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.624967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 985/1991] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:22 2022] POST /identity/v3/projects => generated 399 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:22.624967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e3ede-648c-45ec-9fd4-c1a3c53013b4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.661218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:22.740961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e3ede-648c-45ec-9fd4-c1a3c53013b4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.750238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3be27-4868-4760-9fc7-c89cd7aba969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.751331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3be27-4868-4760-9fc7-c89cd7aba969 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.751969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3be27-4868-4760-9fc7-c89cd7aba969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.752469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3be27-4868-4760-9fc7-c89cd7aba969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.753705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3be27-4868-4760-9fc7-c89cd7aba969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.756012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3be27-4868-4760-9fc7-c89cd7aba969 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.772839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 986/1992] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:22.773825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3be27-4868-4760-9fc7-c89cd7aba969 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.781522 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d166e-a8e2-45f4-8d30-f4d3d35e9e2f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.787925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3be27-4868-4760-9fc7-c89cd7aba969 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.796225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4106c-8f0f-48bc-8aca-ebd9ea67ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.797052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d6ad1-803c-499e-a917-6aa39261763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.797723 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4106c-8f0f-48bc-8aca-ebd9ea67ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.797876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4106c-8f0f-48bc-8aca-ebd9ea67ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.798095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4106c-8f0f-48bc-8aca-ebd9ea67ef00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.798265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d6ad1-803c-499e-a917-6aa39261763a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.798523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d6ad1-803c-499e-a917-6aa39261763a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.798881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d6ad1-803c-499e-a917-6aa39261763a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.799027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4106c-8f0f-48bc-8aca-ebd9ea67ef00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.801150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4106c-8f0f-48bc-8aca-ebd9ea67ef00 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.803309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d6ad1-803c-499e-a917-6aa39261763a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.805744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d6ad1-803c-499e-a917-6aa39261763a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.819137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 987/1993] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:22.820075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4106c-8f0f-48bc-8aca-ebd9ea67ef00 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.833678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1007/1994] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:22.835090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d6ad1-803c-499e-a917-6aa39261763a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.835373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4106c-8f0f-48bc-8aca-ebd9ea67ef00 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.841932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a670b9-0314-43d9-bf17-59ddb59440ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.843082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a670b9-0314-43d9-bf17-59ddb59440ce admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.843565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a670b9-0314-43d9-bf17-59ddb59440ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.844126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a670b9-0314-43d9-bf17-59ddb59440ce admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.845437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a670b9-0314-43d9-bf17-59ddb59440ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.846339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:22.850276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a670b9-0314-43d9-bf17-59ddb59440ce admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.858670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d6ad1-803c-499e-a917-6aa39261763a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.885633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e276e-f02f-4692-873e-e09491248578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.887198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e276e-f02f-4692-873e-e09491248578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.887655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e276e-f02f-4692-873e-e09491248578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.888160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e276e-f02f-4692-873e-e09491248578 admin admin] PATH_INFO: `/v3/projects/e720a2476fd84d5f8830be5fc546e529/users/d5714c7722ab4e8d910c35b0cc77d768/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.922779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 988/1995] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:22 2022] POST /identity/v3/users => generated 306 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:22.928300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a670b9-0314-43d9-bf17-59ddb59440ce admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.942912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e276e-f02f-4692-873e-e09491248578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e720a2476fd84d5f8830be5fc546e529, user_id=d5714c7722ab4e8d910c35b0cc77d768, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.945683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e276e-f02f-4692-873e-e09491248578 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.951674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a670b9-0314-43d9-bf17-59ddb59440ce admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:22.958658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5679a-6422-419e-b369-b02e5000cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:22.959614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5679a-6422-419e-b369-b02e5000cb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:22.960033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5679a-6422-419e-b369-b02e5000cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:22.960374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5679a-6422-419e-b369-b02e5000cb30 admin admin] PATH_INFO: `/v3/projects/b5d66794ff89434499520173f1fec935/users/b7495430ae1946aab56ae7635bdd41aa/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:22.962898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5679a-6422-419e-b369-b02e5000cb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d66794ff89434499520173f1fec935, user_id=b7495430ae1946aab56ae7635bdd41aa, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:22.971087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1008/1996] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:22 2022] PUT /identity/v3/projects/e720a2476fd84d5f8830be5fc546e529/users/d5714c7722ab4e8d910c35b0cc77d768/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:22.971280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5679a-6422-419e-b369-b02e5000cb30 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:22.971370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e276e-f02f-4692-873e-e09491248578 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:22.981706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 989/1997] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:22 2022] PUT /identity/v3/projects/b5d66794ff89434499520173f1fec935/users/b7495430ae1946aab56ae7635bdd41aa/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:22.983183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5679a-6422-419e-b369-b02e5000cb30 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.043015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e276e-f02f-4692-873e-e09491248578 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.096992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5679a-6422-419e-b369-b02e5000cb30 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.104137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.105753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.106255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.106880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] PATH_INFO: `/v3/users/04f15aaf125f4219a07f23c1084f353e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.108690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f15aaf125f4219a07f23c1084f353e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.111013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.122944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b0a58-b4e3-4c16-ae02-94635983ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.124423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b0a58-b4e3-4c16-ae02-94635983ceba admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.124685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b0a58-b4e3-4c16-ae02-94635983ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.124937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b0a58-b4e3-4c16-ae02-94635983ceba admin admin] PATH_INFO: `/v3/projects/152890a04f014ac7ba4684c56f03fca6/users/080945a7308f4375bf94068207878ac4/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.151025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b0a58-b4e3-4c16-ae02-94635983ceba admin admin] RBAC: Authorizing `identity:create_grant(project_id=152890a04f014ac7ba4684c56f03fca6, user_id=080945a7308f4375bf94068207878ac4, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.157174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b0a58-b4e3-4c16-ae02-94635983ceba admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.193100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1009/1998] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:22 2022] PUT /identity/v3/projects/152890a04f014ac7ba4684c56f03fca6/users/080945a7308f4375bf94068207878ac4/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:23.193100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b0a58-b4e3-4c16-ae02-94635983ceba admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.200725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f15aaf125f4219a07f23c1084f353e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.217774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f15aaf125f4219a07f23c1084f353e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.219075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f15aaf125f4219a07f23c1084f353e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.219700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f15aaf125f4219a07f23c1084f353e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.232755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-1f6fb0bf-31d8-4d55-bd1a-bcd3d24d9c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f15aaf125f4219a07f23c1084f353e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.239139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:23.259828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 990/1999] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:22 2022] DELETE /identity/v3/users/04f15aaf125f4219a07f23c1084f353e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:23.261371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d57cf-32de-4671-a171-f4d90f594b6e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.261674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d57cf-32de-4671-a171-f4d90f594b6e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.261954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d57cf-32de-4671-a171-f4d90f594b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.281882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b0a58-b4e3-4c16-ae02-94635983ceba admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.297033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-383d57cf-32de-4671-a171-f4d90f594b6e None None] MFA Rules not processed for user `d5714c7722ab4e8d910c35b0cc77d768`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:23.298253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-383d57cf-32de-4671-a171-f4d90f594b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.300937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:23.365616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731be5e-f273-4bd8-8d53-202212e9e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.366995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731be5e-f273-4bd8-8d53-202212e9e296 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.366995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731be5e-f273-4bd8-8d53-202212e9e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.366995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731be5e-f273-4bd8-8d53-202212e9e296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.367897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731be5e-f273-4bd8-8d53-202212e9e296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.369675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731be5e-f273-4bd8-8d53-202212e9e296 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.387077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1010/2000] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:23.387077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d271a-7465-4502-a3e6-8e0003b1dc25 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.387077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d271a-7465-4502-a3e6-8e0003b1dc25 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.387077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d271a-7465-4502-a3e6-8e0003b1dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.397212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 991/2001] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:23.401412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d57cf-32de-4671-a171-f4d90f594b6e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.401412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-383d57cf-32de-4671-a171-f4d90f594b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.417619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d57cf-32de-4671-a171-f4d90f594b6e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.424920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8f0d271a-7465-4502-a3e6-8e0003b1dc25 None None] MFA Rules not processed for user `b7495430ae1946aab56ae7635bdd41aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:23.424920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8f0d271a-7465-4502-a3e6-8e0003b1dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.431001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84276-17ab-4c66-bce1-211df15d1828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.432011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84276-17ab-4c66-bce1-211df15d1828 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.432368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84276-17ab-4c66-bce1-211df15d1828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.432671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84276-17ab-4c66-bce1-211df15d1828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.433524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda84276-17ab-4c66-bce1-211df15d1828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.435809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda84276-17ab-4c66-bce1-211df15d1828 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.471518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 992/2002] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:23.473849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab213297-86e5-4e8f-95b4-d2cfcc461c09 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.474343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab213297-86e5-4e8f-95b4-d2cfcc461c09 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.474717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab213297-86e5-4e8f-95b4-d2cfcc461c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.505393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ab213297-86e5-4e8f-95b4-d2cfcc461c09 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:23.507588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ab213297-86e5-4e8f-95b4-d2cfcc461c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.521092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 993/2003] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:23.522353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab213297-86e5-4e8f-95b4-d2cfcc461c09 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.524285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ab213297-86e5-4e8f-95b4-d2cfcc461c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.542816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab213297-86e5-4e8f-95b4-d2cfcc461c09 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.550128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6ad7-df4d-461d-9f89-b272faf5f3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.551648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6ad7-df4d-461d-9f89-b272faf5f3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.552092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6ad7-df4d-461d-9f89-b272faf5f3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.552514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6ad7-df4d-461d-9f89-b272faf5f3b4 admin admin] PATH_INFO: `/v3/projects/62e19b8d9b3f4f8292c245d0240d4703/users/03c617db8aa44bf4bac33bf2cd0f83fd/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.554026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1011/2004] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:23.555068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d271a-7465-4502-a3e6-8e0003b1dc25 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.556673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8f0d271a-7465-4502-a3e6-8e0003b1dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.575313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d271a-7465-4502-a3e6-8e0003b1dc25 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.581835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6ad7-df4d-461d-9f89-b272faf5f3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e19b8d9b3f4f8292c245d0240d4703, user_id=03c617db8aa44bf4bac33bf2cd0f83fd, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.582191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.583276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.583716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.584185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.585193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.585661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6ad7-df4d-461d-9f89-b272faf5f3b4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.587336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.607621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 994/2005] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:23 2022] PUT /identity/v3/projects/62e19b8d9b3f4f8292c245d0240d4703/users/03c617db8aa44bf4bac33bf2cd0f83fd/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:23.608575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6ad7-df4d-461d-9f89-b272faf5f3b4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.625395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1012/2006] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:23 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:23.626455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.628242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.714605 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6ad7-df4d-461d-9f89-b272faf5f3b4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.717828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e20fb-47c4-4d3f-b5ac-3109463a96e0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.720811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.721762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.722053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.722308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] PATH_INFO: `/v3/projects/152890a04f014ac7ba4684c56f03fca6/users/080945a7308f4375bf94068207878ac4/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.723475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.724540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=152890a04f014ac7ba4684c56f03fca6, user_id=080945a7308f4375bf94068207878ac4, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.724733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.724988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.725469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] PATH_INFO: `/v3/users/959c3a711c394cbcb59da0289e16e887` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.727505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.727711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959c3a711c394cbcb59da0289e16e887)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.729581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.754015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 995/2007] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:23 2022] PUT /identity/v3/projects/152890a04f014ac7ba4684c56f03fca6/users/080945a7308f4375bf94068207878ac4/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:23.754015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.754015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.765368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:23.815488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:23.821607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959c3a711c394cbcb59da0289e16e887'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.839882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e2af8-63f1-4e2e-a079-3f49af746aab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:23.844725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:23.845129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959c3a711c394cbcb59da0289e16e887'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.845994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959c3a711c394cbcb59da0289e16e887'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.846230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:23.846731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:23.847246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:23.850042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.858430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959c3a711c394cbcb59da0289e16e887'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.859276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959c3a711c394cbcb59da0289e16e887'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:23.879128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1013/2008] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:23 2022] DELETE /identity/v3/users/959c3a711c394cbcb59da0289e16e887 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:23.881836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:23.885525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:23.972304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:23.973803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:23.995604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662defcd-27bc-4f5d-a2af-7a0c558cc4d5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.001613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 996/2009] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:24.002623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.004670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.020079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.021300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.021825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.022326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.024992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990748b4-2c4e-4cd1-8cb9-9c5692c6ad42 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.025563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.119125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.121900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.142725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312320c-feb5-4487-9232-15309ae3021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.144336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312320c-feb5-4487-9232-15309ae3021e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.144907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1014/2010] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:24.145407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312320c-feb5-4487-9232-15309ae3021e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.145972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312320c-feb5-4487-9232-15309ae3021e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.147905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.148292 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.149204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312320c-feb5-4487-9232-15309ae3021e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.151349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312320c-feb5-4487-9232-15309ae3021e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.168837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75a661-7cbf-4064-b972-2920f2900658 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.177515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 997/2011] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:24.178857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48c5e9-2c71-48d2-b676-3f656725da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.180298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48c5e9-2c71-48d2-b676-3f656725da99 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.180298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48c5e9-2c71-48d2-b676-3f656725da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.180482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48c5e9-2c71-48d2-b676-3f656725da99 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.181163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48c5e9-2c71-48d2-b676-3f656725da99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.183561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd35f-0318-4b4b-bf3b-9296eb46d325 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.184663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd35f-0318-4b4b-bf3b-9296eb46d325 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.190720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd35f-0318-4b4b-bf3b-9296eb46d325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.192333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48c5e9-2c71-48d2-b676-3f656725da99 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.240460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1015/2012] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:24 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:24.242866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053eca-148b-406e-b6e9-af4c7adb3280 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.243471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053eca-148b-406e-b6e9-af4c7adb3280 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.244271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72053eca-148b-406e-b6e9-af4c7adb3280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.256558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f0edd35f-0318-4b4b-bf3b-9296eb46d325 None None] MFA Rules not processed for user `080945a7308f4375bf94068207878ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:24.258792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0edd35f-0318-4b4b-bf3b-9296eb46d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.270094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-72053eca-148b-406e-b6e9-af4c7adb3280 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:24.271876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-72053eca-148b-406e-b6e9-af4c7adb3280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.287875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1016/2013] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:24.289834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72053eca-148b-406e-b6e9-af4c7adb3280 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.304404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72053eca-148b-406e-b6e9-af4c7adb3280 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.310099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.312501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.312780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.315423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] PATH_INFO: `/v3/projects/62e19b8d9b3f4f8292c245d0240d4703/users/03c617db8aa44bf4bac33bf2cd0f83fd/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.318741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e19b8d9b3f4f8292c245d0240d4703, user_id=03c617db8aa44bf4bac33bf2cd0f83fd, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.323352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.355358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1017/2014] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:24 2022] PUT /identity/v3/projects/62e19b8d9b3f4f8292c245d0240d4703/users/03c617db8aa44bf4bac33bf2cd0f83fd/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:24.355358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.355358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.365708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:24.391703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 998/2015] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:24.396708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edd35f-0318-4b4b-bf3b-9296eb46d325 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.411520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edd35f-0318-4b4b-bf3b-9296eb46d325 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.419254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:24.448477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9eab-86c8-4bed-b072-903b48c6bbc3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.454104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe7e21-51a6-41e7-b879-135d3959a008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.454790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe7e21-51a6-41e7-b879-135d3959a008 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.455134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe7e21-51a6-41e7-b879-135d3959a008 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.455417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe7e21-51a6-41e7-b879-135d3959a008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.457429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6fbe7e21-51a6-41e7-b879-135d3959a008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.495221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.495963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.496727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.497587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.497849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.499613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.512892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 999/2016] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:24.517080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.518812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.566301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe7e21-51a6-41e7-b879-135d3959a008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.567887 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe7e21-51a6-41e7-b879-135d3959a008 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.598663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1018/2017] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:24.601035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b03438-7dcd-42da-aa32-110d5b0d6ac1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.601597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b03438-7dcd-42da-aa32-110d5b0d6ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.602174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b03438-7dcd-42da-aa32-110d5b0d6ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.631273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b780d-dc35-4a7d-9b81-e21e94e853a7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.636045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309143a1-e6c3-4d1d-befd-2d2cc8b0d72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.636719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309143a1-e6c3-4d1d-befd-2d2cc8b0d72a service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.636997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309143a1-e6c3-4d1d-befd-2d2cc8b0d72a service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.637325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309143a1-e6c3-4d1d-befd-2d2cc8b0d72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.650070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309143a1-e6c3-4d1d-befd-2d2cc8b0d72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.651792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309143a1-e6c3-4d1d-befd-2d2cc8b0d72a service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.659998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-15b03438-7dcd-42da-aa32-110d5b0d6ac1 None None] MFA Rules not processed for user `03c617db8aa44bf4bac33bf2cd0f83fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:24.661580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15b03438-7dcd-42da-aa32-110d5b0d6ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.669172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1000/2018] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:24.670279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309143a1-e6c3-4d1d-befd-2d2cc8b0d72a service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.687618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309143a1-e6c3-4d1d-befd-2d2cc8b0d72a service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.693412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c35432-0678-4c22-90ff-e38393b78f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.695017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c35432-0678-4c22-90ff-e38393b78f53 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.695695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c35432-0678-4c22-90ff-e38393b78f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.696259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c35432-0678-4c22-90ff-e38393b78f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.864225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c35432-0678-4c22-90ff-e38393b78f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.866768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c35432-0678-4c22-90ff-e38393b78f53 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.893607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1001/2019] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:24.894878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c35432-0678-4c22-90ff-e38393b78f53 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.912482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c35432-0678-4c22-90ff-e38393b78f53 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.921129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea25ddf-adaf-4de1-a25b-cb643b64a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.922939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea25ddf-adaf-4de1-a25b-cb643b64a66b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.923494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea25ddf-adaf-4de1-a25b-cb643b64a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.924294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea25ddf-adaf-4de1-a25b-cb643b64a66b admin admin] PATH_INFO: `/v3/projects/d99981f839ae4d60816077ade1e7240f/users/20888b95a7f5427bbd1386290cfe7f46/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.935277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1019/2020] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:24.936331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b03438-7dcd-42da-aa32-110d5b0d6ac1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:24.941498 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15b03438-7dcd-42da-aa32-110d5b0d6ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:24.966162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea25ddf-adaf-4de1-a25b-cb643b64a66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99981f839ae4d60816077ade1e7240f, user_id=20888b95a7f5427bbd1386290cfe7f46, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.976617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea25ddf-adaf-4de1-a25b-cb643b64a66b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:24.980664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b03438-7dcd-42da-aa32-110d5b0d6ac1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:24.986185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:24.987388 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:24.987700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:24.987997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] PATH_INFO: `/v3/projects/71dc92359e2a4d3da7c3917ee134bbe8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:24.989615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71dc92359e2a4d3da7c3917ee134bbe8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:24.993598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:25.013933 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1002/2021] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:24 2022] PUT /identity/v3/projects/d99981f839ae4d60816077ade1e7240f/users/20888b95a7f5427bbd1386290cfe7f46/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:25.015620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f484-972c-47cf-883c-15658922839e None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:25.015910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f484-972c-47cf-883c-15658922839e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:25.016390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51f484-972c-47cf-883c-15658922839e None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:25.018730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1003/2022] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:29:25.019321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51f484-972c-47cf-883c-15658922839e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:25.043753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:25.076520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:25.090838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71dc92359e2a4d3da7c3917ee134bbe8', 'request_id': 'req-a805cdf4-b523-48bc-ad59-168086491fb7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.100003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51f484-972c-47cf-883c-15658922839e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:25.104334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71dc92359e2a4d3da7c3917ee134bbe8', 'request_id': 'req-a805cdf4-b523-48bc-ad59-168086491fb7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.113406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71dc92359e2a4d3da7c3917ee134bbe8', 'request_id': 'req-a805cdf4-b523-48bc-ad59-168086491fb7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.133840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] The token cache is being invalidate because project 71dc92359e2a4d3da7c3917ee134bbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:25.134291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.135279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.152037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1020/2023] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:24 2022] DELETE /identity/v3/projects/71dc92359e2a4d3da7c3917ee134bbe8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:25.152037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:25.153674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:25.230959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:25.231664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:25.231998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:25.232340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:25.238837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:25.311819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805cdf4-b523-48bc-ad59-168086491fb7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:25.319996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dd721-5e93-4957-9643-dffc7c041b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:25.320214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dd721-5e93-4957-9643-dffc7c041b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:25.320416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dd721-5e93-4957-9643-dffc7c041b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:25.320652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dd721-5e93-4957-9643-dffc7c041b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:25.321771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dd721-5e93-4957-9643-dffc7c041b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:25.323433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dd721-5e93-4957-9643-dffc7c041b50 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:25.345038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1021/2024] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:25.347418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc863-e0fb-4436-9fbf-0554431edf54 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:25.347709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc863-e0fb-4436-9fbf-0554431edf54 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:25.348640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc863-e0fb-4436-9fbf-0554431edf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:25.401322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b58fc863-e0fb-4436-9fbf-0554431edf54 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:25.403512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b58fc863-e0fb-4436-9fbf-0554431edf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:25.410478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:25.412582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:25.454059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1004/2025] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:25.455136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:25.461373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:25.487541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f120f-8f6a-4db4-ab3a-ad2e0848b914 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:25.494553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:25.496661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:25.497609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:25.499253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] PATH_INFO: `/v3/users/ccf83bdb08ec4313a4ce11d00729207f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:25.501371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf83bdb08ec4313a4ce11d00729207f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:25.506477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:25.540458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1022/2026] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:25.542323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc863-e0fb-4436-9fbf-0554431edf54 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:25.584152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc863-e0fb-4436-9fbf-0554431edf54 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:25.592102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:25.593546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:25.595724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:25.595724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] PATH_INFO: `/v3/projects/d99981f839ae4d60816077ade1e7240f/users/20888b95a7f5427bbd1386290cfe7f46/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:25.598383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99981f839ae4d60816077ade1e7240f, user_id=20888b95a7f5427bbd1386290cfe7f46, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:25.603713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:25.635166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1023/2027] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:25 2022] PUT /identity/v3/projects/d99981f839ae4d60816077ade1e7240f/users/20888b95a7f5427bbd1386290cfe7f46/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:25.635166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:25.635771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf83bdb08ec4313a4ce11d00729207f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.641491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:25.657052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf83bdb08ec4313a4ce11d00729207f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.657930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf83bdb08ec4313a4ce11d00729207f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.658637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf83bdb08ec4313a4ce11d00729207f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.675595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf83bdb08ec4313a4ce11d00729207f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:25.683823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:25.704487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1005/2028] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:25 2022] DELETE /identity/v3/users/ccf83bdb08ec4313a4ce11d00729207f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:25.705516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:25.707611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:25.755036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:25.789491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff365e5-9399-4304-ad28-572e4eaabfcc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:25.889703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea741d3-492d-44d1-bc45-6ed05135a8df admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:25.903839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:25.904634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:25.905169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:25.905384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:25.907765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:25.927589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:25.930685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:25.962735 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1006/2029] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:25.965495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:25.968640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:25.980831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:25.984460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:25.984860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:25.985106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] PATH_INFO: `/v3/projects/0ba8c989b87b46a49ba4b911803e33ce` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:25.988476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba8c989b87b46a49ba4b911803e33ce)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:25.994083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:26.115012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba8c989b87b46a49ba4b911803e33ce', 'request_id': 'req-582d0ca3-29d3-423b-90af-1b706e2e91e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.121905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f231450-e1ec-4941-a72a-8e6b3b84b59b service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:26.126301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba8c989b87b46a49ba4b911803e33ce', 'request_id': 'req-582d0ca3-29d3-423b-90af-1b706e2e91e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.138469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba8c989b87b46a49ba4b911803e33ce', 'request_id': 'req-582d0ca3-29d3-423b-90af-1b706e2e91e1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.175217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] The token cache is being invalidate because project 0ba8c989b87b46a49ba4b911803e33ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:26.175515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.177099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-582d0ca3-29d3-423b-90af-1b706e2e91e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.180878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1024/2030] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:25 2022] DELETE /identity/v3/projects/0ba8c989b87b46a49ba4b911803e33ce => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:26.182850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055096-9328-48c1-94c0-f1f9d89772ed None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:26.187581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055096-9328-48c1-94c0-f1f9d89772ed None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:26.187923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055096-9328-48c1-94c0-f1f9d89772ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:26.259088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a1055096-9328-48c1-94c0-f1f9d89772ed None None] MFA Rules not processed for user `20888b95a7f5427bbd1386290cfe7f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:26.261501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a1055096-9328-48c1-94c0-f1f9d89772ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:26.266681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:26.267396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:26.267683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:26.267961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:26.272388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:26.363583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:26.377999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:26.381986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:26.390315 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1007/2031] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:26.391331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:26.392901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:26.446870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1025/2032] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:26.447804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055096-9328-48c1-94c0-f1f9d89772ed None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:26.450771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a1055096-9328-48c1-94c0-f1f9d89772ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:26.475532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:26.572758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9271-27dc-4e38-882d-fc51eb1e67ec service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:26.584199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:26.585372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:26.585778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:26.586157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] PATH_INFO: `/v3/users/a3d44a529baf49979ee4d302261d3bb3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:26.587635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d44a529baf49979ee4d302261d3bb3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:26.589764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:26.611330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055096-9328-48c1-94c0-f1f9d89772ed None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:26.616964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:26.617985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:26.618244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:26.618551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] PATH_INFO: `/v3/projects/ed90247ed3d04bc7b5f8d50c06cd8588` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:26.620493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed90247ed3d04bc7b5f8d50c06cd8588)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:26.623249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:26.659467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d44a529baf49979ee4d302261d3bb3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.681499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d44a529baf49979ee4d302261d3bb3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.682781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d44a529baf49979ee4d302261d3bb3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.683948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d44a529baf49979ee4d302261d3bb3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.697442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d44a529baf49979ee4d302261d3bb3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.719910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1008/2033] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:26 2022] DELETE /identity/v3/users/a3d44a529baf49979ee4d302261d3bb3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:26.721671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:26.729160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:26.732092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed90247ed3d04bc7b5f8d50c06cd8588', 'request_id': 'req-42e30787-8273-489a-99de-03b1a3ab0e80'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.751408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed90247ed3d04bc7b5f8d50c06cd8588', 'request_id': 'req-42e30787-8273-489a-99de-03b1a3ab0e80'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.763792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed90247ed3d04bc7b5f8d50c06cd8588', 'request_id': 'req-42e30787-8273-489a-99de-03b1a3ab0e80'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.789021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] The token cache is being invalidate because project ed90247ed3d04bc7b5f8d50c06cd8588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:26.789293 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.791521 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:26.799724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1026/2034] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:26 2022] DELETE /identity/v3/projects/ed90247ed3d04bc7b5f8d50c06cd8588 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:26.803696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:26.806717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:26.850395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a96870-f66f-4313-8227-fd53fd54e3ab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:26.862836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:26.863834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:26.864154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:26.868686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] PATH_INFO: `/v3/users/47eaa64990b6464dbd96a5171edafa9d` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:26.871695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47eaa64990b6464dbd96a5171edafa9d)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:26.877547 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:26.912163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:27.008395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e30787-8273-489a-99de-03b1a3ab0e80 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:27.013920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47eaa64990b6464dbd96a5171edafa9d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.041022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47eaa64990b6464dbd96a5171edafa9d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.041833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47eaa64990b6464dbd96a5171edafa9d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.044052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47eaa64990b6464dbd96a5171edafa9d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.086924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba6d3638-b38e-4d60-ac7e-dd7312e38be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47eaa64990b6464dbd96a5171edafa9d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.123081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1009/2035] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:26 2022] DELETE /identity/v3/users/47eaa64990b6464dbd96a5171edafa9d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:27.124928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e465f-5e78-478c-b510-f07ab37ea7ba None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.125237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e465f-5e78-478c-b510-f07ab37ea7ba None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.125853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e465f-5e78-478c-b510-f07ab37ea7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.149061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:27.150396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.150396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.150396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.152243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.157035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-185e465f-5e78-478c-b510-f07ab37ea7ba None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:27.158727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-185e465f-5e78-478c-b510-f07ab37ea7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.160816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:27.285144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:27.286633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:27.297086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1010/2036] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:27.299444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d99d8-f07f-4896-82fc-598b7910fa40 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.299714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d99d8-f07f-4896-82fc-598b7910fa40 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.299981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d99d8-f07f-4896-82fc-598b7910fa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.338763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1027/2037] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:27.340231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:27.345050 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.377724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cd5d99d8-f07f-4896-82fc-598b7910fa40 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:27.383819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cd5d99d8-f07f-4896-82fc-598b7910fa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.386044 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523cb12-4b10-49be-bec8-8850d4827346 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:27.400719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1011/2038] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:27.402647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d0aa-9a91-4d88-a617-4c98749e1766 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.402950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d0aa-9a91-4d88-a617-4c98749e1766 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.403500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d0aa-9a91-4d88-a617-4c98749e1766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.415028 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:27.416863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.417513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.418870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] PATH_INFO: `/v3/projects/9c4b7f42d4e4486faa167e32d708e622` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.420992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4b7f42d4e4486faa167e32d708e622)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:27.423838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:27.432636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-17d9d0aa-9a91-4d88-a617-4c98749e1766 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:27.434199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-17d9d0aa-9a91-4d88-a617-4c98749e1766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.445403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1012/2039] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:27.445403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9d0aa-9a91-4d88-a617-4c98749e1766 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:27.445403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-17d9d0aa-9a91-4d88-a617-4c98749e1766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.537163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4b7f42d4e4486faa167e32d708e622', 'request_id': 'req-c75c41f1-1493-4804-abaf-08f4da7d2e36'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.552747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4b7f42d4e4486faa167e32d708e622', 'request_id': 'req-c75c41f1-1493-4804-abaf-08f4da7d2e36'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.570681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4b7f42d4e4486faa167e32d708e622', 'request_id': 'req-c75c41f1-1493-4804-abaf-08f4da7d2e36'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.588362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] The token cache is being invalidate because project 9c4b7f42d4e4486faa167e32d708e622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:27.589605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.590801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:27.604391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1028/2040] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:27 2022] DELETE /identity/v3/projects/9c4b7f42d4e4486faa167e32d708e622 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:27.604391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:27.606370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.608379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9d0aa-9a91-4d88-a617-4c98749e1766 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:27.676067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:27.724260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8655-87db-47a9-9d21-1bf8acfd674d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:27.725394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8655-87db-47a9-9d21-1bf8acfd674d service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.729007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8655-87db-47a9-9d21-1bf8acfd674d service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.729007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8655-87db-47a9-9d21-1bf8acfd674d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.729334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d1ce8655-87db-47a9-9d21-1bf8acfd674d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.793002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c41f1-1493-4804-abaf-08f4da7d2e36 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:27.817279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e50b2-3894-45af-81c9-74afb07e0b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:27.818865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e50b2-3894-45af-81c9-74afb07e0b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.819365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e50b2-3894-45af-81c9-74afb07e0b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.819820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e50b2-3894-45af-81c9-74afb07e0b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.825924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e50b2-3894-45af-81c9-74afb07e0b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:27.829619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e50b2-3894-45af-81c9-74afb07e0b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:27.835601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e50b2-3894-45af-81c9-74afb07e0b9d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:27.880072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1029/2041] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:27.881311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e4b10-0fda-4512-afab-4b2dd3545941 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.882646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e4b10-0fda-4512-afab-4b2dd3545941 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.883061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e4b10-0fda-4512-afab-4b2dd3545941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.915121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0c6e4b10-0fda-4512-afab-4b2dd3545941 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:27.916594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c6e4b10-0fda-4512-afab-4b2dd3545941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:27.935105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1030/2042] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:27.936193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e4b10-0fda-4512-afab-4b2dd3545941 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:27.945214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8655-87db-47a9-9d21-1bf8acfd674d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:27.947882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8655-87db-47a9-9d21-1bf8acfd674d service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:27.964789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e4b10-0fda-4512-afab-4b2dd3545941 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:27.969589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1013/2043] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:27.970063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f60611-1e9f-419c-bacf-90dd0fa04699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:27.971078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f60611-1e9f-419c-bacf-90dd0fa04699 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.971704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f60611-1e9f-419c-bacf-90dd0fa04699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.971875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d536566-46ba-4068-b743-7fae2f6d7a4d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:27.972179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f60611-1e9f-419c-bacf-90dd0fa04699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.972377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d536566-46ba-4068-b743-7fae2f6d7a4d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:27.972657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d536566-46ba-4068-b743-7fae2f6d7a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:27.973186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f60611-1e9f-419c-bacf-90dd0fa04699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:27.975452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f60611-1e9f-419c-bacf-90dd0fa04699 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:27.988051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:28.012803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1d536566-46ba-4068-b743-7fae2f6d7a4d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:28.013155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1031/2044] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:27 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:28.016505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1d536566-46ba-4068-b743-7fae2f6d7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:28.018537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f60611-1e9f-419c-bacf-90dd0fa04699 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.142863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1014/2045] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:28.146683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d536566-46ba-4068-b743-7fae2f6d7a4d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.161676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d536566-46ba-4068-b743-7fae2f6d7a4d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.167541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f60611-1e9f-419c-bacf-90dd0fa04699 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.169903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.171493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.172539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.173302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.174469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:28.180361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11ccb2-494e-4e70-afed-cc9b014a00b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.180361 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11ccb2-494e-4e70-afed-cc9b014a00b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.180552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.180638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11ccb2-494e-4e70-afed-cc9b014a00b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.180638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11ccb2-494e-4e70-afed-cc9b014a00b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.180772 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11ccb2-494e-4e70-afed-cc9b014a00b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.182668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.182779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11ccb2-494e-4e70-afed-cc9b014a00b4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.206734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1015/2046] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:28.212016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.233673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1032/2047] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:28 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:28.239604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3538356-d170-472b-af8c-3d13b50eb158 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.247071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11ccb2-494e-4e70-afed-cc9b014a00b4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.255373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767aa1-85ad-4c8f-9143-892b58c71362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.257174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767aa1-85ad-4c8f-9143-892b58c71362 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.257683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767aa1-85ad-4c8f-9143-892b58c71362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.258151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767aa1-85ad-4c8f-9143-892b58c71362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.259137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7767aa1-85ad-4c8f-9143-892b58c71362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.262492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7767aa1-85ad-4c8f-9143-892b58c71362 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.265717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11ccb2-494e-4e70-afed-cc9b014a00b4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.280525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298743-81c3-468a-ae2f-2d44095f1165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.282352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298743-81c3-468a-ae2f-2d44095f1165 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.282637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298743-81c3-468a-ae2f-2d44095f1165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.282915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298743-81c3-468a-ae2f-2d44095f1165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.286376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43298743-81c3-468a-ae2f-2d44095f1165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.289291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43298743-81c3-468a-ae2f-2d44095f1165 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.303216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1016/2048] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:28 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:28.307827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767aa1-85ad-4c8f-9143-892b58c71362 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.311181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1033/2049] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:28.316998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298743-81c3-468a-ae2f-2d44095f1165 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.336205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298743-81c3-468a-ae2f-2d44095f1165 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.437660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:28.466354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767aa1-85ad-4c8f-9143-892b58c71362 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.491496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbdc50-6122-454f-8f48-8437920a4d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.492247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbdc50-6122-454f-8f48-8437920a4d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.492507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbdc50-6122-454f-8f48-8437920a4d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.492790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbdc50-6122-454f-8f48-8437920a4d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.496874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbdc50-6122-454f-8f48-8437920a4d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.496874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbdc50-6122-454f-8f48-8437920a4d12 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.533579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d873cea-b9be-441f-ada6-1d28ee388b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.535187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d873cea-b9be-441f-ada6-1d28ee388b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.535906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d873cea-b9be-441f-ada6-1d28ee388b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.536724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d873cea-b9be-441f-ada6-1d28ee388b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.538352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d873cea-b9be-441f-ada6-1d28ee388b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.541721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d873cea-b9be-441f-ada6-1d28ee388b68 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.545144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1017/2050] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:28 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:28.546700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbdc50-6122-454f-8f48-8437920a4d12 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.571855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbdc50-6122-454f-8f48-8437920a4d12 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.597895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa6c00-a096-4221-aeb8-6d656166bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.598823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6c00-a096-4221-aeb8-6d656166bbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.599291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6c00-a096-4221-aeb8-6d656166bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.599724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6c00-a096-4221-aeb8-6d656166bbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.600632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa6c00-a096-4221-aeb8-6d656166bbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.603177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa6c00-a096-4221-aeb8-6d656166bbd7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.610345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1034/2051] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:28.613878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d873cea-b9be-441f-ada6-1d28ee388b68 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.627633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1018/2052] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:28.631973 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa6c00-a096-4221-aeb8-6d656166bbd7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.644448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d873cea-b9be-441f-ada6-1d28ee388b68 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.649495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa6c00-a096-4221-aeb8-6d656166bbd7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.663277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7f18-9570-4e19-b72a-15afb0f12c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.663277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7f18-9570-4e19-b72a-15afb0f12c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.663277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7f18-9570-4e19-b72a-15afb0f12c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.663277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7f18-9570-4e19-b72a-15afb0f12c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.663954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7f18-9570-4e19-b72a-15afb0f12c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.663954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7f18-9570-4e19-b72a-15afb0f12c69 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.664212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ec359-76ee-4fda-800a-5f16359bd52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.675428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec359-76ee-4fda-800a-5f16359bd52b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.681445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec359-76ee-4fda-800a-5f16359bd52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.681445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec359-76ee-4fda-800a-5f16359bd52b admin admin] PATH_INFO: `/v3/projects/3853d65bed914b779e921f3f24b1c157/users/5ee6fc0a7b5a45a09a524cc6562cb77b/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.712772 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1019/2053] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:28.721424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7f18-9570-4e19-b72a-15afb0f12c69 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:28.744053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ec359-76ee-4fda-800a-5f16359bd52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3853d65bed914b779e921f3f24b1c157, user_id=5ee6fc0a7b5a45a09a524cc6562cb77b, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:28.752239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ec359-76ee-4fda-800a-5f16359bd52b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:28.775666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7f18-9570-4e19-b72a-15afb0f12c69 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:28.785772 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1035/2054] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:28 2022] PUT /identity/v3/projects/3853d65bed914b779e921f3f24b1c157/users/5ee6fc0a7b5a45a09a524cc6562cb77b/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:28.792696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d93ac-864f-4720-bd95-486cd907c5f0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.793554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d93ac-864f-4720-bd95-486cd907c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.794364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d93ac-864f-4720-bd95-486cd907c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:28.860760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b23d93ac-864f-4720-bd95-486cd907c5f0 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:28.864265 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b23d93ac-864f-4720-bd95-486cd907c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:28.974344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:28.976733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:28.981285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:28.982099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] PATH_INFO: `/v3/projects/20c73ce18af14d79917c1825ec33cca5/users/5f04ac653937477cadc359ed77cd47bf/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:29.020212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:29.060424 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c73ce18af14d79917c1825ec33cca5, user_id=5f04ac653937477cadc359ed77cd47bf, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:29.067078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:29.107825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1036/2055] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:29.110672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1020/2056] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:28 2022] PUT /identity/v3/projects/20c73ce18af14d79917c1825ec33cca5/users/5f04ac653937477cadc359ed77cd47bf/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:29.122280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18faa-db46-4f64-909e-3d4aacbd534a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:29.122625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18faa-db46-4f64-909e-3d4aacbd534a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:29.125826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:29.133937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18faa-db46-4f64-909e-3d4aacbd534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:29.137217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:29.188027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3cc18faa-db46-4f64-909e-3d4aacbd534a None None] MFA Rules not processed for user `5f04ac653937477cadc359ed77cd47bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:29.189987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3cc18faa-db46-4f64-909e-3d4aacbd534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:29.336275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1037/2057] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:29.342736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18faa-db46-4f64-909e-3d4aacbd534a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:29.345038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7f429-c8f7-4f1d-979e-2d4332d616f9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:29.361750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:29.363038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:29.364113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:29.365430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:29.464739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:29.469252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18faa-db46-4f64-909e-3d4aacbd534a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:29.483455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550563-0e2d-4b0d-b756-5a177e374d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:29.486931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550563-0e2d-4b0d-b756-5a177e374d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:29.487466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550563-0e2d-4b0d-b756-5a177e374d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:29.488235 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550563-0e2d-4b0d-b756-5a177e374d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:29.488601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550563-0e2d-4b0d-b756-5a177e374d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:29.493984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550563-0e2d-4b0d-b756-5a177e374d0d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:29.509241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:29.512599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:29.527711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1021/2058] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:29.528848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:29.531002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:29.551435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62530d-a53a-425d-8c56-c7df5d6b5268 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:29.563204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1038/2059] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:29 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:29.567328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:29.568651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550563-0e2d-4b0d-b756-5a177e374d0d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:29.569397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:29.570957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:29.571313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] PATH_INFO: `/v3/projects/5198b71d93eb44e593e7bb28a2a2cca7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:29.580549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5198b71d93eb44e593e7bb28a2a2cca7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:29.583422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:29.687908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:29.691644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5198b71d93eb44e593e7bb28a2a2cca7', 'request_id': 'req-ecfbf2c8-26ac-49e7-88bd-36250345006c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:29.699993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550563-0e2d-4b0d-b756-5a177e374d0d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:29.704014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5198b71d93eb44e593e7bb28a2a2cca7', 'request_id': 'req-ecfbf2c8-26ac-49e7-88bd-36250345006c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:29.719866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5198b71d93eb44e593e7bb28a2a2cca7', 'request_id': 'req-ecfbf2c8-26ac-49e7-88bd-36250345006c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:29.756810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] The token cache is being invalidate because project 5198b71d93eb44e593e7bb28a2a2cca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:29.758475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:29.761135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:29.769095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1022/2060] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:29 2022] DELETE /identity/v3/projects/5198b71d93eb44e593e7bb28a2a2cca7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:29.770730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:29.773336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:29.887820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:29.887820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:29.887820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:29.887820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:29.888729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:29.891331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:29.981402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf2c8-26ac-49e7-88bd-36250345006c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:29.987160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:29.988318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:29.988630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:29.988993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] PATH_INFO: `/v3/users/080945a7308f4375bf94068207878ac4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:29.990410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=080945a7308f4375bf94068207878ac4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:29.995564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:30.031586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1039/2061] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:29 2022] POST /identity/v3/users => generated 300 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:30.034143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:30.039446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:30.059978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6f1f9-09dc-4c59-994a-7a500126ca44 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:30.069024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e1136-54e6-4d4b-8d1c-7051bf0f32b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:30.070407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1136-54e6-4d4b-8d1c-7051bf0f32b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.071219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1136-54e6-4d4b-8d1c-7051bf0f32b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.071726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1136-54e6-4d4b-8d1c-7051bf0f32b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:30.075573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e1136-54e6-4d4b-8d1c-7051bf0f32b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:30.080819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e1136-54e6-4d4b-8d1c-7051bf0f32b4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:30.095326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080945a7308f4375bf94068207878ac4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.116789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1040/2062] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:30.118146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e1136-54e6-4d4b-8d1c-7051bf0f32b4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:30.143550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e1136-54e6-4d4b-8d1c-7051bf0f32b4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:30.145102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080945a7308f4375bf94068207878ac4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.147490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080945a7308f4375bf94068207878ac4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.149091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080945a7308f4375bf94068207878ac4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.150133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:30.153039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.153373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.153693 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] PATH_INFO: `/v3/projects/c4497cfa7bb04eaa8f8b2319ae54b1ab/users/ea041e029d7b4a698ee862e504d28f20/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:30.165758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080945a7308f4375bf94068207878ac4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.168398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:30.185213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4497cfa7bb04eaa8f8b2319ae54b1ab, user_id=ea041e029d7b4a698ee862e504d28f20, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:30.189330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:30.201042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1023/2063] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:29 2022] DELETE /identity/v3/users/080945a7308f4375bf94068207878ac4 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:30.202840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:30.207092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:30.230908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1041/2064] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:30 2022] PUT /identity/v3/projects/c4497cfa7bb04eaa8f8b2319ae54b1ab/users/ea041e029d7b4a698ee862e504d28f20/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:30.235781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:30.240485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:30.413619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff824bc5-1deb-4503-bee0-ed029b656c2e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:30.415448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a6612-6937-43d9-b61a-a46af0e85972 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:30.426221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:30.427183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.427466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.427745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] PATH_INFO: `/v3/users/f2945b928e14454296983a32987e8c14` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:30.433560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2945b928e14454296983a32987e8c14)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:30.438485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a298ff-3f8e-49ba-94df-5f1fa0a03298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:30.439215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a298ff-3f8e-49ba-94df-5f1fa0a03298 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.439494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a298ff-3f8e-49ba-94df-5f1fa0a03298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.439767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a298ff-3f8e-49ba-94df-5f1fa0a03298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:30.440515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a298ff-3f8e-49ba-94df-5f1fa0a03298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:30.442180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a298ff-3f8e-49ba-94df-5f1fa0a03298 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:30.465357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:30.478787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1042/2065] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:30.484908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a298ff-3f8e-49ba-94df-5f1fa0a03298 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:30.517575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a298ff-3f8e-49ba-94df-5f1fa0a03298 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:30.532181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239009a-282c-4891-b88a-06cd6f6bc2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:30.534203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239009a-282c-4891-b88a-06cd6f6bc2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.535502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239009a-282c-4891-b88a-06cd6f6bc2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.535991 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239009a-282c-4891-b88a-06cd6f6bc2ed admin admin] PATH_INFO: `/v3/projects/c4497cfa7bb04eaa8f8b2319ae54b1ab/users/ea041e029d7b4a698ee862e504d28f20/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:30.544767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239009a-282c-4891-b88a-06cd6f6bc2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4497cfa7bb04eaa8f8b2319ae54b1ab, user_id=ea041e029d7b4a698ee862e504d28f20, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:30.548198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239009a-282c-4891-b88a-06cd6f6bc2ed admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:30.583393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2945b928e14454296983a32987e8c14'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.603444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1043/2066] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:30 2022] PUT /identity/v3/projects/c4497cfa7bb04eaa8f8b2319ae54b1ab/users/ea041e029d7b4a698ee862e504d28f20/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:30.605689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50740a-06c2-4e78-90e0-fd89202b9e52 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.606294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50740a-06c2-4e78-90e0-fd89202b9e52 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.607065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50740a-06c2-4e78-90e0-fd89202b9e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:30.609674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2945b928e14454296983a32987e8c14'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.620106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2945b928e14454296983a32987e8c14'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.623701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2945b928e14454296983a32987e8c14'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.636187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f43560b2-7432-49eb-8998-31b6986f2b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2945b928e14454296983a32987e8c14'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.659111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1024/2067] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:30 2022] DELETE /identity/v3/users/f2945b928e14454296983a32987e8c14 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:30.662920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a40261-777d-4cb8-9251-8ce1c6c55a13 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.663364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a40261-777d-4cb8-9251-8ce1c6c55a13 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.663718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a40261-777d-4cb8-9251-8ce1c6c55a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:30.682372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7a50740a-06c2-4e78-90e0-fd89202b9e52 None None] MFA Rules not processed for user `ea041e029d7b4a698ee862e504d28f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:30.683617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7a50740a-06c2-4e78-90e0-fd89202b9e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:30.694534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b1a40261-777d-4cb8-9251-8ce1c6c55a13 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:30.697190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b1a40261-777d-4cb8-9251-8ce1c6c55a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:30.753183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:30.809770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1025/2068] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:29:30.811518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a40261-777d-4cb8-9251-8ce1c6c55a13 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:30.814858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b1a40261-777d-4cb8-9251-8ce1c6c55a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:30.828402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a40261-777d-4cb8-9251-8ce1c6c55a13 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:30.833555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:30.834456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.834737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.835059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] PATH_INFO: `/v3/users/d5714c7722ab4e8d910c35b0cc77d768` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:30.836461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5714c7722ab4e8d910c35b0cc77d768)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:30.838456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:30.844486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:30.845467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1044/2069] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:30.850440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50740a-06c2-4e78-90e0-fd89202b9e52 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:30.852624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7a50740a-06c2-4e78-90e0-fd89202b9e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:30.935622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5714c7722ab4e8d910c35b0cc77d768'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:30.987739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50740a-06c2-4e78-90e0-fd89202b9e52 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:30.994508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:30.995595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:30.995903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:30.996196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:31.005032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5714c7722ab4e8d910c35b0cc77d768'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.007293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5714c7722ab4e8d910c35b0cc77d768'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.008050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5714c7722ab4e8d910c35b0cc77d768'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.009538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:31.011761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:31.027304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1045/2070] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:31.028960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:31.031576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.037339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6c0fd4d8-2ac8-4aa7-8647-41a66b88cc6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5714c7722ab4e8d910c35b0cc77d768'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.072387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1026/2071] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:30 2022] DELETE /identity/v3/users/d5714c7722ab4e8d910c35b0cc77d768 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:31.074670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393436bf-964d-4ee1-9135-d2e8906b28e3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:31.075587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393436bf-964d-4ee1-9135-d2e8906b28e3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:31.076113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393436bf-964d-4ee1-9135-d2e8906b28e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:31.116362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-393436bf-964d-4ee1-9135-d2e8906b28e3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:31.118535 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-393436bf-964d-4ee1-9135-d2e8906b28e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.120624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c999b2-dc1a-476b-a514-9448907fd8d0 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:31.274269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1027/2072] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:31.276327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:31.277399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5288-0641-40e7-ba9d-5c63d911776e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:31.277528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:31.277754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:31.278101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:31.279147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5288-0641-40e7-ba9d-5c63d911776e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:31.279670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5288-0641-40e7-ba9d-5c63d911776e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:31.289597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.355914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-6c7e5288-0641-40e7-ba9d-5c63d911776e None None] MFA Rules not processed for user `5ee6fc0a7b5a45a09a524cc6562cb77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:31.359780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c7e5288-0641-40e7-ba9d-5c63d911776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.396834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:31.445835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:31.447789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:31.462666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1046/2073] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:31.464303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:31.467242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.549272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1028/2074] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:31.550199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e5288-0641-40e7-ba9d-5c63d911776e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:31.555342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6c7e5288-0641-40e7-ba9d-5c63d911776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.574553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e5288-0641-40e7-ba9d-5c63d911776e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:31.578334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc8295-6c45-4a18-bb06-67570f53caf8 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:31.580269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:31.581281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:31.581620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:31.582025 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] PATH_INFO: `/v3/projects/152890a04f014ac7ba4684c56f03fca6` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:31.583237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:31.583562 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=152890a04f014ac7ba4684c56f03fca6)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:31.583944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:31.584397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:31.584676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:31.586170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:31.598875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:31.599993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:31.604879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:31.614048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1047/2075] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:31.616115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:31.617468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.634352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41090765-f462-40cd-8498-5537c434a516 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:31.640253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:31.640919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:31.641298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:31.641482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:31.642458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:31.644675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:31.690187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1048/2076] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:31 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:31.690187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:31.692608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.702469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152890a04f014ac7ba4684c56f03fca6', 'request_id': 'req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.711826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152890a04f014ac7ba4684c56f03fca6', 'request_id': 'req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.721088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152890a04f014ac7ba4684c56f03fca6', 'request_id': 'req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.752221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] The token cache is being invalidate because project 152890a04f014ac7ba4684c56f03fca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:31.752545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.756312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.758410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1029/2077] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:31 2022] DELETE /identity/v3/projects/152890a04f014ac7ba4684c56f03fca6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:31.760863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:31.762359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:31.820977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c3500-b565-4078-82af-32f400a0079b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:31.826219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:31.827198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:31.827485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:31.827759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] PATH_INFO: `/v3/projects/8aee1988a19f4bdf8b1edc804eba4d42` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:31.829093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aee1988a19f4bdf8b1edc804eba4d42)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:31.831142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:31.917833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aee1988a19f4bdf8b1edc804eba4d42', 'request_id': 'req-5036cd71-92cb-4a4a-b231-34e03141d6b4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.925351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0aeb1-4469-4397-a0cf-5834b5d8a36a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:31.932295 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aee1988a19f4bdf8b1edc804eba4d42', 'request_id': 'req-5036cd71-92cb-4a4a-b231-34e03141d6b4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.935542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:31.944814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aee1988a19f4bdf8b1edc804eba4d42', 'request_id': 'req-5036cd71-92cb-4a4a-b231-34e03141d6b4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.972714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] The token cache is being invalidate because project 8aee1988a19f4bdf8b1edc804eba4d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:31.973074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.974005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:31.976332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1049/2078] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:31 2022] DELETE /identity/v3/projects/8aee1988a19f4bdf8b1edc804eba4d42 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:31.977277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:31.978689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.059494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288749-44db-43df-bc59-7c5600311896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:32.060269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288749-44db-43df-bc59-7c5600311896 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.060548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288749-44db-43df-bc59-7c5600311896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.060828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288749-44db-43df-bc59-7c5600311896 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.061544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81288749-44db-43df-bc59-7c5600311896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:32.063788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81288749-44db-43df-bc59-7c5600311896 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:32.100951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1030/2079] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:31 2022] POST /identity/v3/users => generated 292 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:32.103174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503551ca-140e-4416-871c-86766fe7756c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.103740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503551ca-140e-4416-871c-86766fe7756c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.104235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503551ca-140e-4416-871c-86766fe7756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.115812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cd71-92cb-4a4a-b231-34e03141d6b4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:32.123068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:32.124455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.124910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.125297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] PATH_INFO: `/v3/users/5f04ac653937477cadc359ed77cd47bf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.127990 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f04ac653937477cadc359ed77cd47bf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:32.135787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:32.151582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-503551ca-140e-4416-871c-86766fe7756c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:32.152759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-503551ca-140e-4416-871c-86766fe7756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.162661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1031/2080] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:32.163393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503551ca-140e-4416-871c-86766fe7756c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:32.165765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-503551ca-140e-4416-871c-86766fe7756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.178300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503551ca-140e-4416-871c-86766fe7756c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:32.183698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:32.185190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.185666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.186943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] PATH_INFO: `/v3/users/b7495430ae1946aab56ae7635bdd41aa` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.189576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7495430ae1946aab56ae7635bdd41aa)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:32.191744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:32.213636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f04ac653937477cadc359ed77cd47bf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.223888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:32.240514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f04ac653937477cadc359ed77cd47bf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.241947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f04ac653937477cadc359ed77cd47bf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.259493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f04ac653937477cadc359ed77cd47bf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.260672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f04ac653937477cadc359ed77cd47bf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.269355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7495430ae1946aab56ae7635bdd41aa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.283972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1050/2081] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:31 2022] DELETE /identity/v3/users/5f04ac653937477cadc359ed77cd47bf => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:32.285501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:32.287854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.293277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7495430ae1946aab56ae7635bdd41aa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.294795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7495430ae1946aab56ae7635bdd41aa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.295706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7495430ae1946aab56ae7635bdd41aa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.310558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7495430ae1946aab56ae7635bdd41aa'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.332630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1032/2082] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:32 2022] DELETE /identity/v3/users/b7495430ae1946aab56ae7635bdd41aa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:32.336753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:32.338294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.390710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd39c91-e0cf-4488-9e95-3cf2a7d7a16a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:32.401694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:32.448551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b46fb6-f0fa-4f95-942f-a34b3f7dc2ed admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:32.457982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:32.459160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.459511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.459914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] PATH_INFO: `/v3/projects/e720a2476fd84d5f8830be5fc546e529` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.462107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e720a2476fd84d5f8830be5fc546e529)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:32.465481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:32.478439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:32.479645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.479645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.479963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.480575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:32.482275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:32.493345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1051/2083] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:32.494246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:32.497211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.511366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43bab0-1fa5-4972-af37-52f7cc57cc6b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:32.517957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:32.519199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.519658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.519930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] PATH_INFO: `/v3/users/36d784e5d78845b0a5370712c5ca7746` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.521342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d784e5d78845b0a5370712c5ca7746)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:32.523763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:32.553944 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e720a2476fd84d5f8830be5fc546e529', 'request_id': 'req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.564406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e720a2476fd84d5f8830be5fc546e529', 'request_id': 'req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.573897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e720a2476fd84d5f8830be5fc546e529', 'request_id': 'req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.589439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] The token cache is being invalidate because project e720a2476fd84d5f8830be5fc546e529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:32.589858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.590539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3d5304ad-dac8-4c60-9947-2334d7ca5d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.594107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1033/2084] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:32 2022] DELETE /identity/v3/projects/e720a2476fd84d5f8830be5fc546e529 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:32.595556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf4f3-7e33-4114-b9d8-ee7eaef3e91c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.596163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf4f3-7e33-4114-b9d8-ee7eaef3e91c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.596475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf4f3-7e33-4114-b9d8-ee7eaef3e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.597502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d784e5d78845b0a5370712c5ca7746'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.615516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d784e5d78845b0a5370712c5ca7746'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.616548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d784e5d78845b0a5370712c5ca7746'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.618732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-275bf4f3-7e33-4114-b9d8-ee7eaef3e91c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:32.620192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-275bf4f3-7e33-4114-b9d8-ee7eaef3e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.626267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d784e5d78845b0a5370712c5ca7746'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.628407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-db867e00-6bc5-4b54-927f-2961090603a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d784e5d78845b0a5370712c5ca7746'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.652252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1052/2085] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:32 2022] DELETE /identity/v3/users/36d784e5d78845b0a5370712c5ca7746 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:32.655587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:32.657963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880b63e-db5a-4a88-9038-8e10be050387 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.658394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880b63e-db5a-4a88-9038-8e10be050387 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.658820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880b63e-db5a-4a88-9038-8e10be050387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.681596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8880b63e-db5a-4a88-9038-8e10be050387 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:32.683066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8880b63e-db5a-4a88-9038-8e10be050387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.719144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1034/2086] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:32.719144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bf4f3-7e33-4114-b9d8-ee7eaef3e91c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:32.720170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-275bf4f3-7e33-4114-b9d8-ee7eaef3e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.739905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bf4f3-7e33-4114-b9d8-ee7eaef3e91c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:32.761069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1053/2087] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:32.762537 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880b63e-db5a-4a88-9038-8e10be050387 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:32.764876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8880b63e-db5a-4a88-9038-8e10be050387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.778684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880b63e-db5a-4a88-9038-8e10be050387 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:32.783938 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:32.784813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.785092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.785367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] PATH_INFO: `/v3/users/20888b95a7f5427bbd1386290cfe7f46` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.786786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20888b95a7f5427bbd1386290cfe7f46)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:32.789642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:32.806783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:32.828087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02ecb6-47c1-409c-985f-8d255537fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:32.829056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02ecb6-47c1-409c-985f-8d255537fc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.829335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02ecb6-47c1-409c-985f-8d255537fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.829611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02ecb6-47c1-409c-985f-8d255537fc34 admin admin] PATH_INFO: `/v3/projects/8099b520e6db46c7acfca8ff96565d8f/users/3d192fa087f94e20a4f7ee6f8b883a85/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.844787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20888b95a7f5427bbd1386290cfe7f46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.845544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02ecb6-47c1-409c-985f-8d255537fc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8099b520e6db46c7acfca8ff96565d8f, user_id=3d192fa087f94e20a4f7ee6f8b883a85, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:32.848275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02ecb6-47c1-409c-985f-8d255537fc34 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:32.861092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20888b95a7f5427bbd1386290cfe7f46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.861557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1035/2088] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:32 2022] PUT /identity/v3/projects/8099b520e6db46c7acfca8ff96565d8f/users/3d192fa087f94e20a4f7ee6f8b883a85/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:32.862302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20888b95a7f5427bbd1386290cfe7f46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.862916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71d78-54dd-41b2-8fa6-93038f283772 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:32.863235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71d78-54dd-41b2-8fa6-93038f283772 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:32.863512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d71d78-54dd-41b2-8fa6-93038f283772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:32.872729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20888b95a7f5427bbd1386290cfe7f46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.873447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20888b95a7f5427bbd1386290cfe7f46'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:32.886042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-06d71d78-54dd-41b2-8fa6-93038f283772 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:32.887113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-06d71d78-54dd-41b2-8fa6-93038f283772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.895371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1054/2089] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:32 2022] DELETE /identity/v3/users/20888b95a7f5427bbd1386290cfe7f46 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:32.896773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:32.898843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.969910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1036/2090] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:32.971321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d71d78-54dd-41b2-8fa6-93038f283772 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:32.972759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-06d71d78-54dd-41b2-8fa6-93038f283772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:32.985035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d71d78-54dd-41b2-8fa6-93038f283772 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.021984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a97d73-5d1e-4410-be6f-7cc0d3231b30 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.027062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.027945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.028232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.028637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] PATH_INFO: `/v3/projects/b5d66794ff89434499520173f1fec935` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.029841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d66794ff89434499520173f1fec935)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.032846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.054935 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:33.071585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.072642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.072880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.073287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.075396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:33.075396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.078121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.093307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d66794ff89434499520173f1fec935', 'request_id': 'req-e0519ef7-d11c-40f8-9a78-b71a9d0596df'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.102414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d66794ff89434499520173f1fec935', 'request_id': 'req-e0519ef7-d11c-40f8-9a78-b71a9d0596df'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.102858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1037/2091] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:33.103744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.105567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.114184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d66794ff89434499520173f1fec935', 'request_id': 'req-e0519ef7-d11c-40f8-9a78-b71a9d0596df'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.127071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] The token cache is being invalidate because project b5d66794ff89434499520173f1fec935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:33.127641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.128084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.129889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1055/2092] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:32 2022] DELETE /identity/v3/projects/b5d66794ff89434499520173f1fec935 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:33.130679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.132700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.184534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df992a4e-3cf1-4c38-be61-b2b0ebc37ab0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.200733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:33.279190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519ef7-d11c-40f8-9a78-b71a9d0596df admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.282690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.283464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.283820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.284233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.284462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.285152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.285435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.285713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.286457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.286778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.288136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.302774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1056/2093] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:33.303801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.306397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.309033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.311451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.321676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d77adb-1211-4c4f-8a85-6d51d061441f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.328606 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e053992-dbdc-4d50-a363-75bfe7bb4925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.328975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e053992-dbdc-4d50-a363-75bfe7bb4925 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.329362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e053992-dbdc-4d50-a363-75bfe7bb4925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.329689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e053992-dbdc-4d50-a363-75bfe7bb4925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.331809 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4e053992-dbdc-4d50-a363-75bfe7bb4925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.340205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1038/2094] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:33.341194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.342957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.346080 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e053992-dbdc-4d50-a363-75bfe7bb4925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.347792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e053992-dbdc-4d50-a363-75bfe7bb4925 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.359008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a80d5-c087-4a18-87cd-fd1f9f718630 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.359203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1057/2095] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:33.361237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4131e-6d41-4932-b027-14aca532a6a4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.361237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4131e-6d41-4932-b027-14aca532a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.361237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4131e-6d41-4932-b027-14aca532a6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.365353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2c3c1-203d-4124-92f2-f1ea35b8518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.366113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2c3c1-203d-4124-92f2-f1ea35b8518b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.366468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2c3c1-203d-4124-92f2-f1ea35b8518b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.366812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2c3c1-203d-4124-92f2-f1ea35b8518b admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.367737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2c3c1-203d-4124-92f2-f1ea35b8518b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.369697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2c3c1-203d-4124-92f2-f1ea35b8518b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.381118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0bd4131e-6d41-4932-b027-14aca532a6a4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:33.382107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0bd4131e-6d41-4932-b027-14aca532a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.392025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1058/2096] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:33.399085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4131e-6d41-4932-b027-14aca532a6a4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.400561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0bd4131e-6d41-4932-b027-14aca532a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.400761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1039/2097] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:33 2022] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:33.405887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2c3c1-203d-4124-92f2-f1ea35b8518b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.422105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4131e-6d41-4932-b027-14aca532a6a4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.513714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.514890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.515245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.515530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] PATH_INFO: `/v3/projects/d99981f839ae4d60816077ade1e7240f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.516886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99981f839ae4d60816077ade1e7240f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.518824 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.519901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2c3c1-203d-4124-92f2-f1ea35b8518b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.528988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e82174-c855-4c31-8c11-470361e0d1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.531056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e82174-c855-4c31-8c11-470361e0d1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.531676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e82174-c855-4c31-8c11-470361e0d1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.532765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e82174-c855-4c31-8c11-470361e0d1c0 admin admin] PATH_INFO: `/v3/projects/8099b520e6db46c7acfca8ff96565d8f/users/3d192fa087f94e20a4f7ee6f8b883a85/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.536171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e82174-c855-4c31-8c11-470361e0d1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8099b520e6db46c7acfca8ff96565d8f, user_id=3d192fa087f94e20a4f7ee6f8b883a85, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.540607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e82174-c855-4c31-8c11-470361e0d1c0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.567255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1040/2098] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:33 2022] PUT /identity/v3/projects/8099b520e6db46c7acfca8ff96565d8f/users/3d192fa087f94e20a4f7ee6f8b883a85/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:33.567255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7f10-6ba7-44c1-89a1-ad93370787c7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.567255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7f10-6ba7-44c1-89a1-ad93370787c7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.567255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7f10-6ba7-44c1-89a1-ad93370787c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.600713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99981f839ae4d60816077ade1e7240f', 'request_id': 'req-4a957104-3734-4743-95ca-ce1c886d0a7a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.601840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-268a7f10-6ba7-44c1-89a1-ad93370787c7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:33.604063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-268a7f10-6ba7-44c1-89a1-ad93370787c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.620932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99981f839ae4d60816077ade1e7240f', 'request_id': 'req-4a957104-3734-4743-95ca-ce1c886d0a7a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.630725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:33.637823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99981f839ae4d60816077ade1e7240f', 'request_id': 'req-4a957104-3734-4743-95ca-ce1c886d0a7a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.656894 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] The token cache is being invalidate because project d99981f839ae4d60816077ade1e7240f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:33.657557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.658441 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:33.661387 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1059/2099] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:33 2022] DELETE /identity/v3/projects/d99981f839ae4d60816077ade1e7240f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:33.678335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.680972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.734204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:33.757448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1041/2100] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:33.760784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02bcb4-2c1c-47a1-9841-35bcbbb6410c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.761680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02bcb4-2c1c-47a1-9841-35bcbbb6410c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.762176 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02bcb4-2c1c-47a1-9841-35bcbbb6410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.783050 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957104-3734-4743-95ca-ce1c886d0a7a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.795737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155f24c-fd8e-427d-bc47-695994a9285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.796908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155f24c-fd8e-427d-bc47-695994a9285a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.797412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155f24c-fd8e-427d-bc47-695994a9285a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.797909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155f24c-fd8e-427d-bc47-695994a9285a admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.798635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cc02bcb4-2c1c-47a1-9841-35bcbbb6410c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:33.799264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155f24c-fd8e-427d-bc47-695994a9285a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.801507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cc02bcb4-2c1c-47a1-9841-35bcbbb6410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.803644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155f24c-fd8e-427d-bc47-695994a9285a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.814998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1042/2101] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:33.820748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02bcb4-2c1c-47a1-9841-35bcbbb6410c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.848683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02bcb4-2c1c-47a1-9841-35bcbbb6410c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.855238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1060/2102] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:33 2022] POST /identity/v3/users => generated 280 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:33.858255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114bd87-40f0-4b1d-9a04-bf4702cb1e0d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.859188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114bd87-40f0-4b1d-9a04-bf4702cb1e0d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.859939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114bd87-40f0-4b1d-9a04-bf4702cb1e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.861913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.862611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.863195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.863477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.864228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:33.864666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.867404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.891984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1043/2103] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:33.891984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.900933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3114bd87-40f0-4b1d-9a04-bf4702cb1e0d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:33.903323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3114bd87-40f0-4b1d-9a04-bf4702cb1e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:33.918755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ae41-8966-48ba-8b2f-8e440faba6dd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.925659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31151ac2-acaf-42a7-87eb-e7deeb35e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.926181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151ac2-acaf-42a7-87eb-e7deeb35e2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.926460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151ac2-acaf-42a7-87eb-e7deeb35e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.926803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31151ac2-acaf-42a7-87eb-e7deeb35e2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.928131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31151ac2-acaf-42a7-87eb-e7deeb35e2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.929886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31151ac2-acaf-42a7-87eb-e7deeb35e2f8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.931874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1061/2104] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:33.933117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114bd87-40f0-4b1d-9a04-bf4702cb1e0d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.957933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114bd87-40f0-4b1d-9a04-bf4702cb1e0d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.967399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1044/2105] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:33.967399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31151ac2-acaf-42a7-87eb-e7deeb35e2f8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:33.978524 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4467a36-1531-4b81-91fd-092653e037be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.981320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4467a36-1531-4b81-91fd-092653e037be admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.982596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4467a36-1531-4b81-91fd-092653e037be admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.983215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31151ac2-acaf-42a7-87eb-e7deeb35e2f8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:33.983547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4467a36-1531-4b81-91fd-092653e037be admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.985744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4467a36-1531-4b81-91fd-092653e037be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.989100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:33.989839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:33.990152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:33.990484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:33.991321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4467a36-1531-4b81-91fd-092653e037be admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:33.991589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:33.992264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:33.994122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.015456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1045/2106] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:34.016627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.029967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b0fe-9a21-4028-8d62-802628ea51fa admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.036023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5438-311a-44ca-ae0f-d38fc3995953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.036630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5438-311a-44ca-ae0f-d38fc3995953 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.036907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5438-311a-44ca-ae0f-d38fc3995953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.037182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5438-311a-44ca-ae0f-d38fc3995953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.037919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc5438-311a-44ca-ae0f-d38fc3995953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.041629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1062/2107] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:33 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:34.041830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc5438-311a-44ca-ae0f-d38fc3995953 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.041930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4467a36-1531-4b81-91fd-092653e037be admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.054319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1046/2108] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:34.055945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5438-311a-44ca-ae0f-d38fc3995953 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.068789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5438-311a-44ca-ae0f-d38fc3995953 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.147432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd229a0f-42f4-4f62-a9b9-8dcbdef2fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.148435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd229a0f-42f4-4f62-a9b9-8dcbdef2fd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.148815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd229a0f-42f4-4f62-a9b9-8dcbdef2fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.149102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd229a0f-42f4-4f62-a9b9-8dcbdef2fd39 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.150423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd229a0f-42f4-4f62-a9b9-8dcbdef2fd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.159953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4467a36-1531-4b81-91fd-092653e037be admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.164744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd229a0f-42f4-4f62-a9b9-8dcbdef2fd39 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.184870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184215-e191-4afb-aa2b-7bbb0cf3a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.186061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184215-e191-4afb-aa2b-7bbb0cf3a8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.186459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184215-e191-4afb-aa2b-7bbb0cf3a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.186743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184215-e191-4afb-aa2b-7bbb0cf3a8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.187563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6184215-e191-4afb-aa2b-7bbb0cf3a8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.198060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6184215-e191-4afb-aa2b-7bbb0cf3a8a7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.227536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1047/2109] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:34 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:34.227536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd229a0f-42f4-4f62-a9b9-8dcbdef2fd39 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.244452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd229a0f-42f4-4f62-a9b9-8dcbdef2fd39 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.262350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fc862-3567-406b-8bb3-29fef70179db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.263334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fc862-3567-406b-8bb3-29fef70179db admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.263705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fc862-3567-406b-8bb3-29fef70179db admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.264070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fc862-3567-406b-8bb3-29fef70179db admin admin] PATH_INFO: `/v3/projects/33fa65d62f3a4caf9fce83dde57f3c7f/users/643c15b4c7dd4008a36cb9f3f2ad1933/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.275728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1063/2110] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:34 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:34.276815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184215-e191-4afb-aa2b-7bbb0cf3a8a7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.294381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fc862-3567-406b-8bb3-29fef70179db admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa65d62f3a4caf9fce83dde57f3c7f, user_id=643c15b4c7dd4008a36cb9f3f2ad1933, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.302986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fc862-3567-406b-8bb3-29fef70179db admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.346527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1048/2111] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:34 2022] PUT /identity/v3/projects/33fa65d62f3a4caf9fce83dde57f3c7f/users/643c15b4c7dd4008a36cb9f3f2ad1933/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:34.347915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fc862-3567-406b-8bb3-29fef70179db admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.388069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184215-e191-4afb-aa2b-7bbb0cf3a8a7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.393902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:34.415475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:34.475645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4c713-6c3f-4dda-b524-1b01cf4f269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.476774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4c713-6c3f-4dda-b524-1b01cf4f269d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.477239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4c713-6c3f-4dda-b524-1b01cf4f269d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.477713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4c713-6c3f-4dda-b524-1b01cf4f269d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.479260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4c713-6c3f-4dda-b524-1b01cf4f269d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.482171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fc862-3567-406b-8bb3-29fef70179db admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.482370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4c713-6c3f-4dda-b524-1b01cf4f269d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.490186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee679f56-12fa-4815-b516-2d317d61aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.491421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee679f56-12fa-4815-b516-2d317d61aa26 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.491945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee679f56-12fa-4815-b516-2d317d61aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.492489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee679f56-12fa-4815-b516-2d317d61aa26 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.493736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee679f56-12fa-4815-b516-2d317d61aa26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.496823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee679f56-12fa-4815-b516-2d317d61aa26 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.499707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1064/2112] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:34.502839 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831d3d-e345-4668-bad5-29611bcd4961 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.502839 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831d3d-e345-4668-bad5-29611bcd4961 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.502839 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831d3d-e345-4668-bad5-29611bcd4961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.538958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-81831d3d-e345-4668-bad5-29611bcd4961 None None] MFA Rules not processed for user `643c15b4c7dd4008a36cb9f3f2ad1933`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:34.540945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1049/2113] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:34 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:34.542927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee679f56-12fa-4815-b516-2d317d61aa26 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.543621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-81831d3d-e345-4668-bad5-29611bcd4961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:34.554193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee679f56-12fa-4815-b516-2d317d61aa26 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.560149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fab2e2-3756-406d-8115-6b83150bd083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.561109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fab2e2-3756-406d-8115-6b83150bd083 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.561542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fab2e2-3756-406d-8115-6b83150bd083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.561985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fab2e2-3756-406d-8115-6b83150bd083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.563510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fab2e2-3756-406d-8115-6b83150bd083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.565506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fab2e2-3756-406d-8115-6b83150bd083 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.590329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1050/2114] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:34.591974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fab2e2-3756-406d-8115-6b83150bd083 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.605284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fab2e2-3756-406d-8115-6b83150bd083 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.612065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27c2b5-2669-43b9-b00a-978b462cfe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.613281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c2b5-2669-43b9-b00a-978b462cfe62 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.613724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c2b5-2669-43b9-b00a-978b462cfe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.614297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c2b5-2669-43b9-b00a-978b462cfe62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.615462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27c2b5-2669-43b9-b00a-978b462cfe62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.618178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27c2b5-2669-43b9-b00a-978b462cfe62 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.633351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1051/2115] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:34.634752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27c2b5-2669-43b9-b00a-978b462cfe62 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.639594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1065/2116] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:34 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:34.640440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831d3d-e345-4668-bad5-29611bcd4961 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.657684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27c2b5-2669-43b9-b00a-978b462cfe62 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.657918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831d3d-e345-4668-bad5-29611bcd4961 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.659952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c21ac-d224-4ba1-91ae-9e52286fe73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.661395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c21ac-d224-4ba1-91ae-9e52286fe73b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.662005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c21ac-d224-4ba1-91ae-9e52286fe73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.662434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c21ac-d224-4ba1-91ae-9e52286fe73b admin admin] PATH_INFO: `/v3/projects/73c1d19b0aab4896b2a8594078aaff1e/users/e541f055c7e0461688d4e9b7b43d108c/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.667394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.668245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.668614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.668974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.669963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.672632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.683221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c21ac-d224-4ba1-91ae-9e52286fe73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c1d19b0aab4896b2a8594078aaff1e, user_id=e541f055c7e0461688d4e9b7b43d108c, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.687959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c21ac-d224-4ba1-91ae-9e52286fe73b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.692190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1066/2117] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:34.693299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.697137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:34.726818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1052/2118] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:34 2022] PUT /identity/v3/projects/73c1d19b0aab4896b2a8594078aaff1e/users/e541f055c7e0461688d4e9b7b43d108c/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:34.728655 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c21ac-d224-4ba1-91ae-9e52286fe73b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:34.804978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c21ac-d224-4ba1-91ae-9e52286fe73b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.810714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b722a26-9be6-4b46-bb35-16150e088acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.811702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722a26-9be6-4b46-bb35-16150e088acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.812650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722a26-9be6-4b46-bb35-16150e088acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.812650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722a26-9be6-4b46-bb35-16150e088acb admin admin] PATH_INFO: `/v3/projects/8bfe3d2b47cd451cb939e106ddbe5514/users/8f3da3cca6e540bd8a1b3b27b1b9def0/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.831216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b722a26-9be6-4b46-bb35-16150e088acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfe3d2b47cd451cb939e106ddbe5514, user_id=8f3da3cca6e540bd8a1b3b27b1b9def0, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:34.833785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b722a26-9be6-4b46-bb35-16150e088acb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:34.868956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1053/2119] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:34 2022] PUT /identity/v3/projects/8bfe3d2b47cd451cb939e106ddbe5514/users/8f3da3cca6e540bd8a1b3b27b1b9def0/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:34.884375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda9c4-9d74-4887-82e1-b70fcd5caa0c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.884668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda9c4-9d74-4887-82e1-b70fcd5caa0c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.884942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda9c4-9d74-4887-82e1-b70fcd5caa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.902456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a883c-d22f-4d07-91ef-5b722301d7ab admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:34.938181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4dbda9c4-9d74-4887-82e1-b70fcd5caa0c None None] MFA Rules not processed for user `e541f055c7e0461688d4e9b7b43d108c`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:34.942099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4dbda9c4-9d74-4887-82e1-b70fcd5caa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:34.977075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:34.977980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:34.978323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:34.978687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:34.990572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:35.059595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:35.086539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1054/2120] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:35.087968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8384f-4c55-49b9-bcb1-d8327e84aba8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.088373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8384f-4c55-49b9-bcb1-d8327e84aba8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.089217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8384f-4c55-49b9-bcb1-d8327e84aba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.092412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:35.094185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:35.107302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1067/2121] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:34 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:35.108432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:35.110233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.133824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8cc8384f-4c55-49b9-bcb1-d8327e84aba8 None None] MFA Rules not processed for user `3d192fa087f94e20a4f7ee6f8b883a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:35.135770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8cc8384f-4c55-49b9-bcb1-d8327e84aba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.196711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae2343-6f73-41a6-ad8b-4a6b7318e763 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:35.206549 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:35.207470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.207812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.208125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] PATH_INFO: `/v3/projects/c7b67824d1fc4de69c649647473c8c58` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.209357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b67824d1fc4de69c649647473c8c58)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:35.211514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:35.230528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1055/2122] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:35.230528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922932-08fc-4eee-a828-db8f11e45873 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.230528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922932-08fc-4eee-a828-db8f11e45873 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.230528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922932-08fc-4eee-a828-db8f11e45873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.267107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-97922932-08fc-4eee-a828-db8f11e45873 None None] MFA Rules not processed for user `8f3da3cca6e540bd8a1b3b27b1b9def0`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:35.269188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-97922932-08fc-4eee-a828-db8f11e45873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.278331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b67824d1fc4de69c649647473c8c58', 'request_id': 'req-ab99a3d0-0e8a-4581-88b7-4a860915cb25'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.288538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b67824d1fc4de69c649647473c8c58', 'request_id': 'req-ab99a3d0-0e8a-4581-88b7-4a860915cb25'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.297045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b67824d1fc4de69c649647473c8c58', 'request_id': 'req-ab99a3d0-0e8a-4581-88b7-4a860915cb25'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.314464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] The token cache is being invalidate because project c7b67824d1fc4de69c649647473c8c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:35.314923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.317105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.323892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1068/2123] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:35 2022] DELETE /identity/v3/projects/c7b67824d1fc4de69c649647473c8c58 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:35.323892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:35.323892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.377525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:35.398572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1056/2124] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:35.399624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922932-08fc-4eee-a828-db8f11e45873 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:35.404524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-97922932-08fc-4eee-a828-db8f11e45873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.418599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99a3d0-0e8a-4581-88b7-4a860915cb25 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:35.426571 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:35.428140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.428917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.429447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] PATH_INFO: `/v3/projects/20c73ce18af14d79917c1825ec33cca5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.432755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c73ce18af14d79917c1825ec33cca5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:35.437040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:35.482085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922932-08fc-4eee-a828-db8f11e45873 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:35.486378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45711ed9-81b3-43e4-a1eb-b1bef2fdc324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:35.487180 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711ed9-81b3-43e4-a1eb-b1bef2fdc324 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.487465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711ed9-81b3-43e4-a1eb-b1bef2fdc324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.487817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711ed9-81b3-43e4-a1eb-b1bef2fdc324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.490157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-45711ed9-81b3-43e4-a1eb-b1bef2fdc324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.505785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c73ce18af14d79917c1825ec33cca5', 'request_id': 'req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.509708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:35.514884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c73ce18af14d79917c1825ec33cca5', 'request_id': 'req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.522936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c73ce18af14d79917c1825ec33cca5', 'request_id': 'req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.540985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] The token cache is being invalidate because project 20c73ce18af14d79917c1825ec33cca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:35.541572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.542335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.544404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1069/2125] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:35 2022] DELETE /identity/v3/projects/20c73ce18af14d79917c1825ec33cca5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:35.545229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:35.546702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.585228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45711ed9-81b3-43e4-a1eb-b1bef2fdc324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:35.588108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45711ed9-81b3-43e4-a1eb-b1bef2fdc324 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:35.604291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1057/2126] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:35.606526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16135d9-fbee-4d42-b80e-224df10bdd37 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.607109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16135d9-fbee-4d42-b80e-224df10bdd37 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.607889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16135d9-fbee-4d42-b80e-224df10bdd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.640323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e16135d9-fbee-4d42-b80e-224df10bdd37 None None] MFA Rules not processed for user `5ee6fc0a7b5a45a09a524cc6562cb77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:35.642673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e16135d9-fbee-4d42-b80e-224df10bdd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.651988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878ab7-aa7a-40b2-acbf-a03b7f6ae09e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:35.658059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:35.659234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.659681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.660102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] PATH_INFO: `/v3/users/643c15b4c7dd4008a36cb9f3f2ad1933` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.661626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=643c15b4c7dd4008a36cb9f3f2ad1933)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:35.663939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:35.762172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1058/2127] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:35.763554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16135d9-fbee-4d42-b80e-224df10bdd37 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:35.765055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e16135d9-fbee-4d42-b80e-224df10bdd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.774855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643c15b4c7dd4008a36cb9f3f2ad1933'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.797139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16135d9-fbee-4d42-b80e-224df10bdd37 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:35.804490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643c15b4c7dd4008a36cb9f3f2ad1933'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.806047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643c15b4c7dd4008a36cb9f3f2ad1933'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.810283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:35.814023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.814490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.814927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] PATH_INFO: `/v3/users/03c617db8aa44bf4bac33bf2cd0f83fd` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.817444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c617db8aa44bf4bac33bf2cd0f83fd)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:35.819784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:35.823744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:35.834742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643c15b4c7dd4008a36cb9f3f2ad1933'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.835970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643c15b4c7dd4008a36cb9f3f2ad1933'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.865378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1070/2128] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:35 2022] DELETE /identity/v3/users/643c15b4c7dd4008a36cb9f3f2ad1933 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:35.866220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:35.870188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:35.941467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c617db8aa44bf4bac33bf2cd0f83fd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.960384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c617db8aa44bf4bac33bf2cd0f83fd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.961290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c617db8aa44bf4bac33bf2cd0f83fd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.961976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c617db8aa44bf4bac33bf2cd0f83fd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.970299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c617db8aa44bf4bac33bf2cd0f83fd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:35.976365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a03799-7503-4cc8-9ad8-305fb9605338 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:35.981547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:35.982309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:35.982589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:35.982856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:35.983590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:35.985591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:35.987953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1059/2129] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:35 2022] DELETE /identity/v3/users/03c617db8aa44bf4bac33bf2cd0f83fd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:35.989161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:35.990631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.020929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1071/2130] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:36.021841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:36.024724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.043671 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:36.092619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5456e-1dd4-426f-b248-b045fd55efac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:36.116957 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990ae4-5939-4959-9925-d34568b7eb41 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:36.131084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:36.133353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:36.135175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:36.137216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] PATH_INFO: `/v3/users/e541f055c7e0461688d4e9b7b43d108c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:36.138677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e541f055c7e0461688d4e9b7b43d108c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:36.140701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:36.195318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:36.197379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:36.198339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:36.199431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] PATH_INFO: `/v3/users/ea041e029d7b4a698ee862e504d28f20` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:36.203444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea041e029d7b4a698ee862e504d28f20)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:36.206229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:36.211406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e541f055c7e0461688d4e9b7b43d108c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.227260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e541f055c7e0461688d4e9b7b43d108c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.228208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e541f055c7e0461688d4e9b7b43d108c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.238036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e541f055c7e0461688d4e9b7b43d108c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.238864 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e541f055c7e0461688d4e9b7b43d108c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.242418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:36.273220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1072/2131] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:36 2022] DELETE /identity/v3/users/e541f055c7e0461688d4e9b7b43d108c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:36.274807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:36.277683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.282261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea041e029d7b4a698ee862e504d28f20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.301199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea041e029d7b4a698ee862e504d28f20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.301968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea041e029d7b4a698ee862e504d28f20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.302679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea041e029d7b4a698ee862e504d28f20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.319041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d41bfe68-a399-40d0-ac71-3feb8e556a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea041e029d7b4a698ee862e504d28f20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.362847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1060/2132] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:35 2022] DELETE /identity/v3/users/ea041e029d7b4a698ee862e504d28f20 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:36.364239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f1eb-14a2-4181-ab5e-eec683de92b2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:36.364524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f1eb-14a2-4181-ab5e-eec683de92b2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:36.364795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6f1eb-14a2-4181-ab5e-eec683de92b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:36.404485 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dbb6f1eb-14a2-4181-ab5e-eec683de92b2 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:36.405945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbb6f1eb-14a2-4181-ab5e-eec683de92b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.445188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f8393-2454-4b7e-97db-73b21af02cca admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:36.563280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:36.606023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1061/2133] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:36.607587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6f1eb-14a2-4181-ab5e-eec683de92b2 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:36.611804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dbb6f1eb-14a2-4181-ab5e-eec683de92b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.635871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6f1eb-14a2-4181-ab5e-eec683de92b2 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:36.641375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:36.642633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:36.642926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:36.643228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:36.648318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.649779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f33f-d411-4ba4-9507-e4d42e6005a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:36.650508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f33f-d411-4ba4-9507-e4d42e6005a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:36.650823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f33f-d411-4ba4-9507-e4d42e6005a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:36.652008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f33f-d411-4ba4-9507-e4d42e6005a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:36.653376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f33f-d411-4ba4-9507-e4d42e6005a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:36.655418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f33f-d411-4ba4-9507-e4d42e6005a4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:36.689633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1062/2134] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:36 2022] POST /identity/v3/users => generated 293 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:36.690998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b7d2-3773-40dd-b5d7-dfba7086716b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:36.691287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b7d2-3773-40dd-b5d7-dfba7086716b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:36.691615 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b7d2-3773-40dd-b5d7-dfba7086716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:36.712680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9929b7d2-3773-40dd-b5d7-dfba7086716b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:36.715226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9929b7d2-3773-40dd-b5d7-dfba7086716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.727251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1063/2135] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:36.728743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929b7d2-3773-40dd-b5d7-dfba7086716b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:36.730066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9929b7d2-3773-40dd-b5d7-dfba7086716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.750286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929b7d2-3773-40dd-b5d7-dfba7086716b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:36.757296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:36.757569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:36.758683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:36.759987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:36.763799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:36.764049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] PATH_INFO: `/v3/projects/62e19b8d9b3f4f8292c245d0240d4703` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:36.765645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e19b8d9b3f4f8292c245d0240d4703)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:36.768618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:36.787526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1073/2136] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:36.789366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:36.798952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:36.854794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:36.886005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e19b8d9b3f4f8292c245d0240d4703', 'request_id': 'req-a1ba6353-0273-4f14-bad4-c1b2e6db656a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.905583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e19b8d9b3f4f8292c245d0240d4703', 'request_id': 'req-a1ba6353-0273-4f14-bad4-c1b2e6db656a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.925489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e19b8d9b3f4f8292c245d0240d4703', 'request_id': 'req-a1ba6353-0273-4f14-bad4-c1b2e6db656a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.929077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823b712-6e93-45a5-9cd7-91147720d58b service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:36.983326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] The token cache is being invalidate because project 62e19b8d9b3f4f8292c245d0240d4703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:36.983843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.985104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:36.990213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1064/2137] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:36 2022] DELETE /identity/v3/projects/62e19b8d9b3f4f8292c245d0240d4703 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:36.990213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:36.990490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:37.066035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156973-9547-4f79-b45c-ff3f33ae0332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.067534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156973-9547-4f79-b45c-ff3f33ae0332 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.067992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156973-9547-4f79-b45c-ff3f33ae0332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.070164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156973-9547-4f79-b45c-ff3f33ae0332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.076495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3f156973-9547-4f79-b45c-ff3f33ae0332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:37.095968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba6353-0273-4f14-bad4-c1b2e6db656a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:37.104591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.105907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.106279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.106728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.107475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f156973-9547-4f79-b45c-ff3f33ae0332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.108385 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.110047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f156973-9547-4f79-b45c-ff3f33ae0332 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.111052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.125833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1065/2138] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:37.126820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.130560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:37.132026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1074/2139] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:37.133815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ded6-0b09-4dc3-912c-76926335ac4b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.134306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ded6-0b09-4dc3-912c-76926335ac4b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.134751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ded6-0b09-4dc3-912c-76926335ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.152310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f53ab2-98ea-4fbf-aa3f-9651eecab11c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:37.158534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.159510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.159860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.160581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.167218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e932ded6-0b09-4dc3-912c-76926335ac4b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:37.168012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:37.168877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e932ded6-0b09-4dc3-912c-76926335ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:37.179761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1075/2140] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:37.188940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932ded6-0b09-4dc3-912c-76926335ac4b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.193409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.195875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.206495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932ded6-0b09-4dc3-912c-76926335ac4b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:37.216200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe7f9-2cfc-4101-b548-cdc12cc20fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.216200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe7f9-2cfc-4101-b548-cdc12cc20fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.216200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe7f9-2cfc-4101-b548-cdc12cc20fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.216200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe7f9-2cfc-4101-b548-cdc12cc20fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.218363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe7f9-2cfc-4101-b548-cdc12cc20fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.218363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efe7f9-2cfc-4101-b548-cdc12cc20fc0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.238158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1076/2141] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:37.238158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7458-0d7b-41f7-98bf-33afa90a6000 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.238158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7458-0d7b-41f7-98bf-33afa90a6000 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.238158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7458-0d7b-41f7-98bf-33afa90a6000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.257272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1066/2142] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:37.259485 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.272316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-02ad7458-0d7b-41f7-98bf-33afa90a6000 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:37.275189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-02ad7458-0d7b-41f7-98bf-33afa90a6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:37.279995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb49a8-26f3-4f9b-9e18-e540f455262f service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:37.286537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9292fe-550b-44af-b7ea-74afabca065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.287586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9292fe-550b-44af-b7ea-74afabca065f admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.287886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9292fe-550b-44af-b7ea-74afabca065f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.288926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9292fe-550b-44af-b7ea-74afabca065f admin admin] PATH_INFO: `/v3/projects/1c255f1fcb7e47ca951bea03f4ae3657/users/270768294515496bbd66f4376571bd46/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.295819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1077/2143] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:37.296678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad7458-0d7b-41f7-98bf-33afa90a6000 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.309219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad7458-0d7b-41f7-98bf-33afa90a6000 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:37.316502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.317261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9292fe-550b-44af-b7ea-74afabca065f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c255f1fcb7e47ca951bea03f4ae3657, user_id=270768294515496bbd66f4376571bd46, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.317831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.318220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.318603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.319634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:37.319997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.322121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9292fe-550b-44af-b7ea-74afabca065f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.326045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.342949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1067/2144] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:37 2022] PUT /identity/v3/projects/1c255f1fcb7e47ca951bea03f4ae3657/users/270768294515496bbd66f4376571bd46/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:37.355401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b037ae-92f6-4e6c-b706-5fc6146d0117 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.355401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b037ae-92f6-4e6c-b706-5fc6146d0117 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.355401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b037ae-92f6-4e6c-b706-5fc6146d0117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.356851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1078/2145] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:37.358205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.370471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff11875-1684-4e1c-85f7-75e306fa56a3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:37.387616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-60b037ae-92f6-4e6c-b706-5fc6146d0117 None None] MFA Rules not processed for user `270768294515496bbd66f4376571bd46`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:37.388933 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-60b037ae-92f6-4e6c-b706-5fc6146d0117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:37.395020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:37.480599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.481392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.481745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.482059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.486462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.494001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.519195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1068/2146] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:37.525237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b037ae-92f6-4e6c-b706-5fc6146d0117 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.560966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b037ae-92f6-4e6c-b706-5fc6146d0117 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:37.562733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1079/2147] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:37 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:37.563893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.569211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:37.669484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:37.707463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0731183-f56d-488f-bede-ef11a8ca34da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.709037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0731183-f56d-488f-bede-ef11a8ca34da admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.709480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0731183-f56d-488f-bede-ef11a8ca34da admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.709923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0731183-f56d-488f-bede-ef11a8ca34da admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.710889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0731183-f56d-488f-bede-ef11a8ca34da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.713382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df34ff-0b51-44d9-941e-cf22e6a8dd46 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:37.713760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0731183-f56d-488f-bede-ef11a8ca34da admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.728272 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:37.731969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:37.732467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:37.736068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] PATH_INFO: `/v3/projects/c4497cfa7bb04eaa8f8b2319ae54b1ab` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:37.746101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4497cfa7bb04eaa8f8b2319ae54b1ab)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:37.754544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:37.782532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1069/2148] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:37 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:29:37.785066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0731183-f56d-488f-bede-ef11a8ca34da admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.864463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4497cfa7bb04eaa8f8b2319ae54b1ab', 'request_id': 'req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:37.880769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4497cfa7bb04eaa8f8b2319ae54b1ab', 'request_id': 'req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:37.892206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4497cfa7bb04eaa8f8b2319ae54b1ab', 'request_id': 'req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:37.917376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] The token cache is being invalidate because project c4497cfa7bb04eaa8f8b2319ae54b1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:37.917678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:37.920365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:37.922810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1080/2149] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:37 2022] DELETE /identity/v3/projects/c4497cfa7bb04eaa8f8b2319ae54b1ab => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:37.924765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:37.927038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:38.052147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc11d9-9a6a-4e18-9c23-daa6d78f4220 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.060195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0731183-f56d-488f-bede-ef11a8ca34da admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.076213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce65384-771f-4c7e-9ac2-3adf53fd2a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.077146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce65384-771f-4c7e-9ac2-3adf53fd2a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.077455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce65384-771f-4c7e-9ac2-3adf53fd2a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.077737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce65384-771f-4c7e-9ac2-3adf53fd2a96 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.083802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce65384-771f-4c7e-9ac2-3adf53fd2a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.086511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce65384-771f-4c7e-9ac2-3adf53fd2a96 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.086895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dc0c9-c876-4002-b8ed-259ddcc1b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.088083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dc0c9-c876-4002-b8ed-259ddcc1b16c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.088563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dc0c9-c876-4002-b8ed-259ddcc1b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.089038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dc0c9-c876-4002-b8ed-259ddcc1b16c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.091492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dc0c9-c876-4002-b8ed-259ddcc1b16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.107514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dc0c9-c876-4002-b8ed-259ddcc1b16c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.136986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1081/2150] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:37 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:38.139711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34e55-0e30-4f82-8087-28ecda996a75 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.140199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34e55-0e30-4f82-8087-28ecda996a75 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.140793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34e55-0e30-4f82-8087-28ecda996a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.176664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1070/2151] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:37 2022] POST /identity/v3/users => generated 289 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:38.184893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dc0c9-c876-4002-b8ed-259ddcc1b16c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.221047 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dc0c9-c876-4002-b8ed-259ddcc1b16c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.233158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-79c34e55-0e30-4f82-8087-28ecda996a75 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:38.234509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-79c34e55-0e30-4f82-8087-28ecda996a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:38.245575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a40d92-359c-4d62-a025-e8d7a9e7f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.246301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a40d92-359c-4d62-a025-e8d7a9e7f5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.246739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1082/2152] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:38.247810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34e55-0e30-4f82-8087-28ecda996a75 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.248704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a40d92-359c-4d62-a025-e8d7a9e7f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.249300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-79c34e55-0e30-4f82-8087-28ecda996a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:38.249406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a40d92-359c-4d62-a025-e8d7a9e7f5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.250321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a40d92-359c-4d62-a025-e8d7a9e7f5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.265243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34e55-0e30-4f82-8087-28ecda996a75 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.266329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a40d92-359c-4d62-a025-e8d7a9e7f5a2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.276526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b27f2-04ad-4667-9d21-81d309d5f3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.279029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b27f2-04ad-4667-9d21-81d309d5f3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.281670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b27f2-04ad-4667-9d21-81d309d5f3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.281670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b27f2-04ad-4667-9d21-81d309d5f3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.281670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b27f2-04ad-4667-9d21-81d309d5f3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.282329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b27f2-04ad-4667-9d21-81d309d5f3c3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.299349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1071/2153] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:38.304665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1083/2154] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:38.305524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2ee27-2213-4fc3-8825-dd322010a9e4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.305838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2ee27-2213-4fc3-8825-dd322010a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.306097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2ee27-2213-4fc3-8825-dd322010a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.308673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b27f2-04ad-4667-9d21-81d309d5f3c3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.367784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b27f2-04ad-4667-9d21-81d309d5f3c3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.371105 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d9a2ee27-2213-4fc3-8825-dd322010a9e4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:38.373005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d9a2ee27-2213-4fc3-8825-dd322010a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:38.380987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f1d2-cf7d-4805-bb12-5b77fa5de838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.383618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f1d2-cf7d-4805-bb12-5b77fa5de838 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.384018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f1d2-cf7d-4805-bb12-5b77fa5de838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.384205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f1d2-cf7d-4805-bb12-5b77fa5de838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.385601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75f1d2-cf7d-4805-bb12-5b77fa5de838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.394433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75f1d2-cf7d-4805-bb12-5b77fa5de838 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.406599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1072/2155] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:38.407603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2ee27-2213-4fc3-8825-dd322010a9e4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.418369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:38.441287 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1084/2156] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:38.442303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f1d2-cf7d-4805-bb12-5b77fa5de838 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.447081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2ee27-2213-4fc3-8825-dd322010a9e4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.470450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.472459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.472992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.473378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] PATH_INFO: `/v3/projects/bb459fc31e4d4b6ca064a9f420ef5527/users/0664b4accf0f4aa3baa7b38964d89bc7/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.475669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f1d2-cf7d-4805-bb12-5b77fa5de838 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.483785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.484513 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.485003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.485462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.486394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:38.486697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.488436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.512815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb459fc31e4d4b6ca064a9f420ef5527, user_id=0664b4accf0f4aa3baa7b38964d89bc7, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.519563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1085/2157] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:38.521004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.522802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.546263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520415e2-c016-4e69-b08b-cfa91601a86a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.561279 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1073/2158] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:38 2022] PUT /identity/v3/projects/bb459fc31e4d4b6ca064a9f420ef5527/users/0664b4accf0f4aa3baa7b38964d89bc7/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:38.568666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.576127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:38.584538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:38.715007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265900d-b8c8-48fa-a2eb-7b35d81c91be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.716997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265900d-b8c8-48fa-a2eb-7b35d81c91be admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.717487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265900d-b8c8-48fa-a2eb-7b35d81c91be admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.718091 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265900d-b8c8-48fa-a2eb-7b35d81c91be admin admin] PATH_INFO: `/v3/projects/6f8f734ea2284fed9e1335827ba00cec/users/7e88ea056e024c6f9d8a52b8eca12741/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.725498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdab1c-d84e-4705-8e7c-81e63a4d6d3d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.735091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.736620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.736940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.737211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] PATH_INFO: `/v3/projects/33fa65d62f3a4caf9fce83dde57f3c7f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.738563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fa65d62f3a4caf9fce83dde57f3c7f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.740704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.748934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265900d-b8c8-48fa-a2eb-7b35d81c91be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8f734ea2284fed9e1335827ba00cec, user_id=7e88ea056e024c6f9d8a52b8eca12741, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.753879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265900d-b8c8-48fa-a2eb-7b35d81c91be admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.775119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1086/2159] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:38 2022] PUT /identity/v3/projects/6f8f734ea2284fed9e1335827ba00cec/users/7e88ea056e024c6f9d8a52b8eca12741/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:38.776676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265900d-b8c8-48fa-a2eb-7b35d81c91be admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.828986 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fa65d62f3a4caf9fce83dde57f3c7f', 'request_id': 'req-ba864670-6d92-4918-aa3a-ea2efe0429d3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:38.846332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fa65d62f3a4caf9fce83dde57f3c7f', 'request_id': 'req-ba864670-6d92-4918-aa3a-ea2efe0429d3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:38.857214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fa65d62f3a4caf9fce83dde57f3c7f', 'request_id': 'req-ba864670-6d92-4918-aa3a-ea2efe0429d3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:38.875324 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] The token cache is being invalidate because project 33fa65d62f3a4caf9fce83dde57f3c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:38.875698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:38.876361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:38.882766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1074/2160] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:38 2022] DELETE /identity/v3/projects/33fa65d62f3a4caf9fce83dde57f3c7f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:38.882766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:38.892750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:38.902903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265900d-b8c8-48fa-a2eb-7b35d81c91be admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.976246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864670-6d92-4918-aa3a-ea2efe0429d3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:38.984058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.985093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.985918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.993029 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7494a-076f-4bdb-8a78-07b6cb4588d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:38.993713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7494a-076f-4bdb-8a78-07b6cb4588d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:38.993992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7494a-076f-4bdb-8a78-07b6cb4588d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:38.994488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7494a-076f-4bdb-8a78-07b6cb4588d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.994629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:38.995236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7494a-076f-4bdb-8a78-07b6cb4588d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.995362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:38.997871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:38.999116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7494a-076f-4bdb-8a78-07b6cb4588d2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:39.016399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1075/2161] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:39.017441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:39.019466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.030132 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:39.034796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9754e3-9daf-4edb-819a-51818cff073e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:39.039290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1087/2162] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:38 2022] POST /identity/v3/projects => generated 409 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:39.042754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26337f7-e01e-412d-af51-377c3e0dfceb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.044763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26337f7-e01e-412d-af51-377c3e0dfceb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.044763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26337f7-e01e-412d-af51-377c3e0dfceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.047859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:39.049583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.049583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.049583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] PATH_INFO: `/v3/projects/73c1d19b0aab4896b2a8594078aaff1e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.051446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c1d19b0aab4896b2a8594078aaff1e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:39.052946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:39.109145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b26337f7-e01e-412d-af51-377c3e0dfceb None None] MFA Rules not processed for user `7e88ea056e024c6f9d8a52b8eca12741`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:39.111163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b26337f7-e01e-412d-af51-377c3e0dfceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.132173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c1d19b0aab4896b2a8594078aaff1e', 'request_id': 'req-4b55982e-ee21-4ba0-adaf-32201e106eac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:39.146476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c1d19b0aab4896b2a8594078aaff1e', 'request_id': 'req-4b55982e-ee21-4ba0-adaf-32201e106eac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:39.156999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:39.158179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c1d19b0aab4896b2a8594078aaff1e', 'request_id': 'req-4b55982e-ee21-4ba0-adaf-32201e106eac'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:39.177587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] The token cache is being invalidate because project 73c1d19b0aab4896b2a8594078aaff1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:39.178779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:39.179783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4b55982e-ee21-4ba0-adaf-32201e106eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:39.182777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1076/2163] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:39 2022] DELETE /identity/v3/projects/73c1d19b0aab4896b2a8594078aaff1e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:39.184804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e182d-a810-460c-a246-440231c03a6f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.185422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e182d-a810-460c-a246-440231c03a6f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.185908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e182d-a810-460c-a246-440231c03a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.232047 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0c1e182d-a810-460c-a246-440231c03a6f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:39.236509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c1e182d-a810-460c-a246-440231c03a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.309506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1088/2164] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:39.310601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26337f7-e01e-412d-af51-377c3e0dfceb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:39.312162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b26337f7-e01e-412d-af51-377c3e0dfceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.379480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1077/2165] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:39.380697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e182d-a810-460c-a246-440231c03a6f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:39.382253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c1e182d-a810-460c-a246-440231c03a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.400219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e182d-a810-460c-a246-440231c03a6f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:39.407138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21177c41-4e4f-4718-8450-062404e16871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:39.408019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177c41-4e4f-4718-8450-062404e16871 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.408359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177c41-4e4f-4718-8450-062404e16871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.408697 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21177c41-4e4f-4718-8450-062404e16871 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.409565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21177c41-4e4f-4718-8450-062404e16871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:39.414550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21177c41-4e4f-4718-8450-062404e16871 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:39.438039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26337f7-e01e-412d-af51-377c3e0dfceb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:39.447664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1078/2166] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:39 2022] POST /identity/v3/users => generated 305 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:39.447664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5323b2-fc5a-4919-8b39-0d915191f638 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.447664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5323b2-fc5a-4919-8b39-0d915191f638 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.447664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5323b2-fc5a-4919-8b39-0d915191f638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.448616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:39.451002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.451655 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.452564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] PATH_INFO: `/v3/projects/bb459fc31e4d4b6ca064a9f420ef5527/users/0664b4accf0f4aa3baa7b38964d89bc7/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.456939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb459fc31e4d4b6ca064a9f420ef5527, user_id=0664b4accf0f4aa3baa7b38964d89bc7, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:39.462747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:39.468433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5b5323b2-fc5a-4919-8b39-0d915191f638 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:39.471228 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5b5323b2-fc5a-4919-8b39-0d915191f638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.486719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1089/2167] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:39 2022] PUT /identity/v3/projects/bb459fc31e4d4b6ca064a9f420ef5527/users/0664b4accf0f4aa3baa7b38964d89bc7/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:39.489936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:39.492959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.547188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1079/2168] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:39.547188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50c55-61f1-4415-88e5-0fc87c60d953 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.547188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50c55-61f1-4415-88e5-0fc87c60d953 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.547188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50c55-61f1-4415-88e5-0fc87c60d953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.576474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-65c50c55-61f1-4415-88e5-0fc87c60d953 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:39.580335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-65c50c55-61f1-4415-88e5-0fc87c60d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.602276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1080/2169] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:39.603506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50c55-61f1-4415-88e5-0fc87c60d953 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:39.611257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:39.616233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50c55-61f1-4415-88e5-0fc87c60d953 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:39.623487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e95ede-2d24-487e-b48e-e00dcbb646c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:39.624663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95ede-2d24-487e-b48e-e00dcbb646c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.625282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95ede-2d24-487e-b48e-e00dcbb646c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.626109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95ede-2d24-487e-b48e-e00dcbb646c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.627743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95ede-2d24-487e-b48e-e00dcbb646c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:39.630632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95ede-2d24-487e-b48e-e00dcbb646c7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:39.645763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1081/2170] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:39.645763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7f01-e2a6-48c5-915a-23e0da5daa98 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.645763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7f01-e2a6-48c5-915a-23e0da5daa98 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.645763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d7f01-e2a6-48c5-915a-23e0da5daa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.678202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-442d7f01-e2a6-48c5-915a-23e0da5daa98 None None] MFA Rules not processed for user `0664b4accf0f4aa3baa7b38964d89bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:39.679634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-442d7f01-e2a6-48c5-915a-23e0da5daa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.736295 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28069a0f-3a80-4c3f-af4c-9c34ba3965a5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:39.751231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba831e-f3b5-4a91-9979-cd4a3f5457da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:39.751231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba831e-f3b5-4a91-9979-cd4a3f5457da admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.751231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba831e-f3b5-4a91-9979-cd4a3f5457da admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.751231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba831e-f3b5-4a91-9979-cd4a3f5457da admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.751737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba831e-f3b5-4a91-9979-cd4a3f5457da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:39.761045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba831e-f3b5-4a91-9979-cd4a3f5457da admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:39.772381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1082/2171] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:39.773692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0660fb6-55bd-46f8-b55b-d482811804a8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.773975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0660fb6-55bd-46f8-b55b-d482811804a8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.774247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0660fb6-55bd-46f8-b55b-d482811804a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.807905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1090/2172] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:39 2022] POST /identity/v3/projects => generated 375 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:39.807905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba831e-f3b5-4a91-9979-cd4a3f5457da admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:39.813145 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f0660fb6-55bd-46f8-b55b-d482811804a8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:39.814616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f0660fb6-55bd-46f8-b55b-d482811804a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:39.913530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:39.923149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1083/2173] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:39.928320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0660fb6-55bd-46f8-b55b-d482811804a8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:39.946027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0660fb6-55bd-46f8-b55b-d482811804a8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:39.948144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba831e-f3b5-4a91-9979-cd4a3f5457da admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:39.958334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:39.959356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:39.960243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.960713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.961154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.961914 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:39.962153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:39.962602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:39.963001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:39.963908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:39.965033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:39.967251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:39.968598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:39.985196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1084/2174] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:39.986475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:39.989633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:40.006924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1091/2175] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:40.007904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.028621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26148430-88b8-49e3-b0dd-3dd09b4b5505 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.039434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5fcf5-9d7d-43cd-94fb-bff6dfc3f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.040223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5fcf5-9d7d-43cd-94fb-bff6dfc3f41c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.040594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5fcf5-9d7d-43cd-94fb-bff6dfc3f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.043832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5fcf5-9d7d-43cd-94fb-bff6dfc3f41c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.044723 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5fcf5-9d7d-43cd-94fb-bff6dfc3f41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.050108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5fcf5-9d7d-43cd-94fb-bff6dfc3f41c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.073107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb8915-d920-4aa4-94f3-baf8957e910a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.077574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515585f-6ecc-4249-8d13-4500d13c1b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.078308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515585f-6ecc-4249-8d13-4500d13c1b33 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.078661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515585f-6ecc-4249-8d13-4500d13c1b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.079082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515585f-6ecc-4249-8d13-4500d13c1b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.081453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1092/2176] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:40 2022] POST /identity/v3/users => generated 288 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:40.082354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5fcf5-9d7d-43cd-94fb-bff6dfc3f41c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.095637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5fcf5-9d7d-43cd-94fb-bff6dfc3f41c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.104636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.105229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.105943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.105943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.106591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:40.106928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.109055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.111093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:40.130228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1093/2177] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:40.131558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.142175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e24cf-5102-4ae0-86f4-76808f16cd60 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.149892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99cb25-1719-482e-8acc-59c201444735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.151213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99cb25-1719-482e-8acc-59c201444735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.151499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99cb25-1719-482e-8acc-59c201444735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.151775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99cb25-1719-482e-8acc-59c201444735 admin admin] PATH_INFO: `/v3/projects/59f717850d00405a8044dc3b4db393ab/users/3106727234a342d5be83a6af6e5ca055/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.172159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99cb25-1719-482e-8acc-59c201444735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f717850d00405a8044dc3b4db393ab, user_id=3106727234a342d5be83a6af6e5ca055, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.173678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515585f-6ecc-4249-8d13-4500d13c1b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.175238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515585f-6ecc-4249-8d13-4500d13c1b33 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.175386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99cb25-1719-482e-8acc-59c201444735 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.186492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1085/2178] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:40.187342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515585f-6ecc-4249-8d13-4500d13c1b33 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.201584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515585f-6ecc-4249-8d13-4500d13c1b33 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.217678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1094/2179] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:40 2022] PUT /identity/v3/projects/59f717850d00405a8044dc3b4db393ab/users/3106727234a342d5be83a6af6e5ca055/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:40.217678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99cb25-1719-482e-8acc-59c201444735 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.285183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1bdde-142f-4f51-b387-ab7b596c43b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.286997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1bdde-142f-4f51-b387-ab7b596c43b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.287314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1bdde-142f-4f51-b387-ab7b596c43b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.287576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1bdde-142f-4f51-b387-ab7b596c43b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.289895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1bdde-142f-4f51-b387-ab7b596c43b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.292359 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1bdde-142f-4f51-b387-ab7b596c43b8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.342001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1086/2180] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:40 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:40.344174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1bdde-142f-4f51-b387-ab7b596c43b8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.354738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99cb25-1719-482e-8acc-59c201444735 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.460592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1bdde-142f-4f51-b387-ab7b596c43b8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.471541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c731e-d3cc-478e-8776-ed55f7dc6ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.472492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c731e-d3cc-478e-8776-ed55f7dc6ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.472971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c731e-d3cc-478e-8776-ed55f7dc6ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.473433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c731e-d3cc-478e-8776-ed55f7dc6ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.474363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c731e-d3cc-478e-8776-ed55f7dc6ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.476839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c731e-d3cc-478e-8776-ed55f7dc6ab4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.481868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd53c0-afa5-48bc-a772-e42bec319e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.482835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd53c0-afa5-48bc-a772-e42bec319e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.483495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd53c0-afa5-48bc-a772-e42bec319e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.484342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd53c0-afa5-48bc-a772-e42bec319e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.484903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd53c0-afa5-48bc-a772-e42bec319e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.487699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd53c0-afa5-48bc-a772-e42bec319e4c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.500925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1095/2181] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:40.502582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54637a15-587f-479b-8237-9892b78fc76e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.503051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54637a15-587f-479b-8237-9892b78fc76e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.503828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54637a15-587f-479b-8237-9892b78fc76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.551411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-54637a15-587f-479b-8237-9892b78fc76e None None] MFA Rules not processed for user `3106727234a342d5be83a6af6e5ca055`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:40.553220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-54637a15-587f-479b-8237-9892b78fc76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:40.556649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1087/2182] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:40 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:40.556649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449093b-fad1-4e23-86e0-834a875cb757 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.556649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449093b-fad1-4e23-86e0-834a875cb757 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.556649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449093b-fad1-4e23-86e0-834a875cb757 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.557477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1088/2183] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:29:40.558220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449093b-fad1-4e23-86e0-834a875cb757 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.560070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2449093b-fad1-4e23-86e0-834a875cb757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:40.573226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:40.607866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:40.654226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1096/2184] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:40.654462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449093b-fad1-4e23-86e0-834a875cb757 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.658229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54637a15-587f-479b-8237-9892b78fc76e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.659726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.660843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.661250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.661623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] PATH_INFO: `/v3/users/8fea7edff657444ba5ae56a8657b0834` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.662954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fea7edff657444ba5ae56a8657b0834)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.665443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.682485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54637a15-587f-479b-8237-9892b78fc76e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.688766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0bf1d-e2a7-4355-a1ef-0908a7fe231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.689699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0bf1d-e2a7-4355-a1ef-0908a7fe231d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.690182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0bf1d-e2a7-4355-a1ef-0908a7fe231d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.690689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0bf1d-e2a7-4355-a1ef-0908a7fe231d admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.691614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0bf1d-e2a7-4355-a1ef-0908a7fe231d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.693956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0bf1d-e2a7-4355-a1ef-0908a7fe231d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.735149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1097/2185] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:40 2022] POST /identity/v3/users => generated 288 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:40.736474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0bf1d-e2a7-4355-a1ef-0908a7fe231d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.768594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0bf1d-e2a7-4355-a1ef-0908a7fe231d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.770367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fea7edff657444ba5ae56a8657b0834'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:40.777819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.779014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.779397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.779768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.780615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.782374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.791714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fea7edff657444ba5ae56a8657b0834'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:40.795971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fea7edff657444ba5ae56a8657b0834'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:40.796250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1098/2186] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:40.796725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fea7edff657444ba5ae56a8657b0834'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:40.797892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.800040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:40.807795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-892e2d2b-517a-4fd5-a4d3-e1c970b5694e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fea7edff657444ba5ae56a8657b0834'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:40.818184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a63ef-e201-4b2b-b0d9-632cde3d21fa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:40.823323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:40.824065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.824389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.824652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1089/2187] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:40 2022] DELETE /identity/v3/users/8fea7edff657444ba5ae56a8657b0834 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:40.826249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9fd60-2851-4f41-a341-3e7d6e12d001 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:40.826543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9fd60-2851-4f41-a341-3e7d6e12d001 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:40.826826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9fd60-2851-4f41-a341-3e7d6e12d001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.834314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:40.834314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:40.834314 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:40.869818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1099/2188] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:40 2022] POST /identity/v3/users => generated 285 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:40.869818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:40.871941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-57a9fd60-2851-4f41-a341-3e7d6e12d001 None None] MFA Rules not processed for user `bbd510b41d234c96bb43fc1921c8604f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:40.873542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:40.873666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-57a9fd60-2851-4f41-a341-3e7d6e12d001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:40.894859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22219a-3d97-4b47-9ad4-066eafa3cd88 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.004259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1090/2189] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:41.005151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9fd60-2851-4f41-a341-3e7d6e12d001 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.006545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-57a9fd60-2851-4f41-a341-3e7d6e12d001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:41.013956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d375-c1f2-4f35-a4dd-01848ffabed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.018186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d375-c1f2-4f35-a4dd-01848ffabed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.019822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d375-c1f2-4f35-a4dd-01848ffabed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.020527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d375-c1f2-4f35-a4dd-01848ffabed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.022081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9fd60-2851-4f41-a341-3e7d6e12d001 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.022474 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5d375-c1f2-4f35-a4dd-01848ffabed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.028750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5d375-c1f2-4f35-a4dd-01848ffabed8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.036296 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.037181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.037524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.037680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.038451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.040509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.063095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1091/2190] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:41.064856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.068673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:41.082143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1100/2191] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:40 2022] POST /identity/v3/projects => generated 407 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:41.083070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d375-c1f2-4f35-a4dd-01848ffabed8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.100982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e231125-1470-458c-a7b6-a58300e29cc9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.157188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:41.177311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:41.197921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d375-c1f2-4f35-a4dd-01848ffabed8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.201452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.204054 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.204630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.204888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.205239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.205493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.205619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.206063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] PATH_INFO: `/v3/projects/14128a9bc80b451d8b9342757b5b7da6/users/5fa7ec72d4a14f3db50c54e7e64b742b/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.206514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.208284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.224711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1101/2192] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:41.224711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.226751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:41.230402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=14128a9bc80b451d8b9342757b5b7da6, user_id=5fa7ec72d4a14f3db50c54e7e64b742b, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.234783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.259332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1092/2193] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:41 2022] PUT /identity/v3/projects/14128a9bc80b451d8b9342757b5b7da6/users/5fa7ec72d4a14f3db50c54e7e64b742b/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:41.260580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.264989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:41.342203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1964d4-9a1c-460f-8c64-b4db1feb0754 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.374987 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2b522-44ba-487d-b31d-2ac02133b03b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.379887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.380484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.380772 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.381052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.383376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:41.415342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2fd6b-fe6e-4cba-b58a-1447b8b1f911 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.416663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2fd6b-fe6e-4cba-b58a-1447b8b1f911 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.416968 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2fd6b-fe6e-4cba-b58a-1447b8b1f911 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.417237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2fd6b-fe6e-4cba-b58a-1447b8b1f911 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.429770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2fd6b-fe6e-4cba-b58a-1447b8b1f911 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.431426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2fd6b-fe6e-4cba-b58a-1447b8b1f911 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.445094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1102/2194] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:41.446180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2fd6b-fe6e-4cba-b58a-1447b8b1f911 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.462750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.464581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.477410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1093/2195] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:41.478230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.549325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2fd6b-fe6e-4cba-b58a-1447b8b1f911 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.556195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.556888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.557173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.557451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.558199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.560750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.566438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71226-ea9e-4aae-b7c6-75c9f4be9e82 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.573592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e191-a2df-405b-9301-7ec0568e94c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.573859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1103/2196] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:41.574791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.574928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e191-a2df-405b-9301-7ec0568e94c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.575298 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e191-a2df-405b-9301-7ec0568e94c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.575819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e191-a2df-405b-9301-7ec0568e94c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.577431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e191-a2df-405b-9301-7ec0568e94c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.577569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:41.582114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e191-a2df-405b-9301-7ec0568e94c9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.611770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:41.622572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c182051-64ca-41e3-a796-b41d0e267001 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.628691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1094/2197] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:41 2022] POST /identity/v3/users => generated 310 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:41.631288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e191-a2df-405b-9301-7ec0568e94c9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.636725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.640550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.640874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.641369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] PATH_INFO: `/v3/projects/5fa930fe9b5542d09fded8e0ebe57994` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.647161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa930fe9b5542d09fded8e0ebe57994)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.655583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.664309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e191-a2df-405b-9301-7ec0568e94c9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.669768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b737a-c4b9-40f2-b33f-181d2864813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.670693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b737a-c4b9-40f2-b33f-181d2864813f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.671117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b737a-c4b9-40f2-b33f-181d2864813f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.671616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b737a-c4b9-40f2-b33f-181d2864813f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.672460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b737a-c4b9-40f2-b33f-181d2864813f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.672857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:41.676302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b737a-c4b9-40f2-b33f-181d2864813f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.696232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1095/2198] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:41.696232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2001-fda2-4e39-9e14-21fb882ee7cb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.696232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2001-fda2-4e39-9e14-21fb882ee7cb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.696232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2001-fda2-4e39-9e14-21fb882ee7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.748906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d50c2001-fda2-4e39-9e14-21fb882ee7cb None None] MFA Rules not processed for user `5fa7ec72d4a14f3db50c54e7e64b742b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:41.750320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d50c2001-fda2-4e39-9e14-21fb882ee7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:41.767447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa930fe9b5542d09fded8e0ebe57994', 'request_id': 'req-e45bfc59-85d1-455e-8e4e-79564a06fac9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:41.786717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa930fe9b5542d09fded8e0ebe57994', 'request_id': 'req-e45bfc59-85d1-455e-8e4e-79564a06fac9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:41.795971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa930fe9b5542d09fded8e0ebe57994', 'request_id': 'req-e45bfc59-85d1-455e-8e4e-79564a06fac9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:41.827705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] The token cache is being invalidate because project 5fa930fe9b5542d09fded8e0ebe57994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:41.828013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:41.829723 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:41.832099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1104/2199] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:41 2022] DELETE /identity/v3/projects/5fa930fe9b5542d09fded8e0ebe57994 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:41.835919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.841105 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1096/2200] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:41.841747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:41.843188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c2001-fda2-4e39-9e14-21fb882ee7cb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.931021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bfc59-85d1-455e-8e4e-79564a06fac9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.938216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee06c31-899f-4a08-a6e5-84274081be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.939622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee06c31-899f-4a08-a6e5-84274081be7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.941071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee06c31-899f-4a08-a6e5-84274081be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.941821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee06c31-899f-4a08-a6e5-84274081be7a admin admin] PATH_INFO: `/v3/projects/2072142328e6454683e99c6e5e1495b0/users/b6dbc2fbd4b44c9b8dc4613cd58b6c04/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.944462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c2001-fda2-4e39-9e14-21fb882ee7cb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:41.949635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:41.950574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:41.950991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:41.951338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:41.952172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.954372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.972497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee06c31-899f-4a08-a6e5-84274081be7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2072142328e6454683e99c6e5e1495b0, user_id=b6dbc2fbd4b44c9b8dc4613cd58b6c04, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:41.983922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee06c31-899f-4a08-a6e5-84274081be7a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:41.984133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1097/2201] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:41.984133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:41.985920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.013140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566630c8-ec15-4e25-b1e7-ca9943600c9b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.018387 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1105/2202] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:41 2022] PUT /identity/v3/projects/2072142328e6454683e99c6e5e1495b0/users/b6dbc2fbd4b44c9b8dc4613cd58b6c04/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:42.019947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bcf3e-405a-411e-af3a-debdc64c9808 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.020238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bcf3e-405a-411e-af3a-debdc64c9808 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.020515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bcf3e-405a-411e-af3a-debdc64c9808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.039382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9b4bcf3e-405a-411e-af3a-debdc64c9808 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:42.040642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9b4bcf3e-405a-411e-af3a-debdc64c9808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.113431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1106/2203] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:42.120949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.121082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bcf3e-405a-411e-af3a-debdc64c9808 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.121195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.121195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.121195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] PATH_INFO: `/v3/projects/05de61a6fa4a47839a96f6c35b60f58b/users/7da4dc649939494e999a1c1800f135b4/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.121713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9b4bcf3e-405a-411e-af3a-debdc64c9808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.133557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05de61a6fa4a47839a96f6c35b60f58b, user_id=7da4dc649939494e999a1c1800f135b4, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.136325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.143208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bcf3e-405a-411e-af3a-debdc64c9808 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.146749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:42.151709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8094e20-3165-4c7f-925f-54a20c7a84c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.152304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094e20-3165-4c7f-925f-54a20c7a84c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.152583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094e20-3165-4c7f-925f-54a20c7a84c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.152875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094e20-3165-4c7f-925f-54a20c7a84c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.153663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8094e20-3165-4c7f-925f-54a20c7a84c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.155612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8094e20-3165-4c7f-925f-54a20c7a84c3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.163609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1098/2204] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:41 2022] PUT /identity/v3/projects/05de61a6fa4a47839a96f6c35b60f58b/users/7da4dc649939494e999a1c1800f135b4/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:42.165150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.167866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.203000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:42.223884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1107/2205] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:42.226396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff061-8a37-4235-a3ae-f4cb3c7e2635 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.226901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff061-8a37-4235-a3ae-f4cb3c7e2635 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.227703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff061-8a37-4235-a3ae-f4cb3c7e2635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.272311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-84dff061-8a37-4235-a3ae-f4cb3c7e2635 None None] MFA Rules not processed for user `b6dbc2fbd4b44c9b8dc4613cd58b6c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:42.274617 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-84dff061-8a37-4235-a3ae-f4cb3c7e2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.276552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ced86-904c-46d6-b2a1-cea43aba6212 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.353406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1108/2206] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:42.354920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28ab86-890c-4aea-a729-4de021638a3d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.355249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28ab86-890c-4aea-a729-4de021638a3d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.355599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28ab86-890c-4aea-a729-4de021638a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.360884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea839cf1-5daa-4d7c-9183-e4772f401e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.361800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839cf1-5daa-4d7c-9183-e4772f401e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.362073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839cf1-5daa-4d7c-9183-e4772f401e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.362405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839cf1-5daa-4d7c-9183-e4772f401e85 admin admin] PATH_INFO: `/v3/projects/57f42be21f2e423eac11e66bd2ce42c8/users/9860ec7b2bfa484a86035e1d9461f56a/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.382619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4d28ab86-890c-4aea-a729-4de021638a3d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:42.384077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4d28ab86-890c-4aea-a729-4de021638a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.386566 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea839cf1-5daa-4d7c-9183-e4772f401e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f42be21f2e423eac11e66bd2ce42c8, user_id=9860ec7b2bfa484a86035e1d9461f56a, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.389401 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea839cf1-5daa-4d7c-9183-e4772f401e85 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.393010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1109/2207] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:42.394329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda8a6-93d2-41e7-abac-3cd382e5c37d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.394608 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda8a6-93d2-41e7-abac-3cd382e5c37d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.394932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eda8a6-93d2-41e7-abac-3cd382e5c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.416241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1099/2208] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:42 2022] PUT /identity/v3/projects/57f42be21f2e423eac11e66bd2ce42c8/users/9860ec7b2bfa484a86035e1d9461f56a/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:42.417071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea839cf1-5daa-4d7c-9183-e4772f401e85 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.426402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f9eda8a6-93d2-41e7-abac-3cd382e5c37d None None] MFA Rules not processed for user `7da4dc649939494e999a1c1800f135b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:42.428129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f9eda8a6-93d2-41e7-abac-3cd382e5c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.494323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea839cf1-5daa-4d7c-9183-e4772f401e85 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.501181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e254d5-aa0b-4eea-b484-e2316c080cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.501897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e254d5-aa0b-4eea-b484-e2316c080cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.502150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e254d5-aa0b-4eea-b484-e2316c080cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.502425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e254d5-aa0b-4eea-b484-e2316c080cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.503156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e254d5-aa0b-4eea-b484-e2316c080cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.505159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e254d5-aa0b-4eea-b484-e2316c080cb8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.508333 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1110/2209] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:42.509034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eda8a6-93d2-41e7-abac-3cd382e5c37d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.515020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f9eda8a6-93d2-41e7-abac-3cd382e5c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.529652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1100/2210] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:42.530641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e254d5-aa0b-4eea-b484-e2316c080cb8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.541919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e254d5-aa0b-4eea-b484-e2316c080cb8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.547634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.548333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.548593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.548894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.549674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:42.550004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.551770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.565036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1101/2211] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:42.565880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.571897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:42.576425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48809ce-e3a1-46d4-b0cc-4c1f440ef93e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.582495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.583190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.583296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eda8a6-93d2-41e7-abac-3cd382e5c37d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.583470 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.583743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.584474 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.586105 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.587283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca844a-98df-4043-badd-681c607b4d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.588138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca844a-98df-4043-badd-681c607b4d7c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.588812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca844a-98df-4043-badd-681c607b4d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.589093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca844a-98df-4043-badd-681c607b4d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.599775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1102/2212] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:42.600690 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.603142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:42.620213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:42.655904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca844a-98df-4043-badd-681c607b4d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.657672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca844a-98df-4043-badd-681c607b4d7c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.668202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1111/2213] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:42.669158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca844a-98df-4043-badd-681c607b4d7c service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.684978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca844a-98df-4043-badd-681c607b4d7c service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.690365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f0a2-baf7-454e-8d69-7f30cc509acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.691071 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f0a2-baf7-454e-8d69-7f30cc509acd admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.691349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f0a2-baf7-454e-8d69-7f30cc509acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.691642 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f0a2-baf7-454e-8d69-7f30cc509acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.692394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3f0a2-baf7-454e-8d69-7f30cc509acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.692588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97de9a4-488e-44b4-b93e-aaa66035e23f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.694001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3f0a2-baf7-454e-8d69-7f30cc509acd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.696766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980111fd-5986-4f82-a5c9-0a8cbe6fecb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac481e3d57a4b6fa07c120ca26f2e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.697551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980111fd-5986-4f82-a5c9-0a8cbe6fecb4 service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.697804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980111fd-5986-4f82-a5c9-0a8cbe6fecb4 service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.698075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980111fd-5986-4f82-a5c9-0a8cbe6fecb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.708780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1112/2214] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:42.708780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f0a2-baf7-454e-8d69-7f30cc509acd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.712548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980111fd-5986-4f82-a5c9-0a8cbe6fecb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.715274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980111fd-5986-4f82-a5c9-0a8cbe6fecb4 service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.716459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f0a2-baf7-454e-8d69-7f30cc509acd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.721203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d4385-3d99-4e12-8224-4ecd39846d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.721866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4385-3d99-4e12-8224-4ecd39846d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.722134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4385-3d99-4e12-8224-4ecd39846d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.722394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4385-3d99-4e12-8224-4ecd39846d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.723124 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4385-3d99-4e12-8224-4ecd39846d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.725276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4385-3d99-4e12-8224-4ecd39846d51 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.728800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1103/2215] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:42.729844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980111fd-5986-4f82-a5c9-0a8cbe6fecb4 service glance] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.745238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980111fd-5986-4f82-a5c9-0a8cbe6fecb4 service glance] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.756802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe49ae4-8ab8-4386-88de-010bf21ac8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.757926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe49ae4-8ab8-4386-88de-010bf21ac8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.758887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe49ae4-8ab8-4386-88de-010bf21ac8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.758887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe49ae4-8ab8-4386-88de-010bf21ac8d2 admin admin] PATH_INFO: `/v3/projects/57f42be21f2e423eac11e66bd2ce42c8/users/9860ec7b2bfa484a86035e1d9461f56a/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.761322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe49ae4-8ab8-4386-88de-010bf21ac8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f42be21f2e423eac11e66bd2ce42c8, user_id=9860ec7b2bfa484a86035e1d9461f56a, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.765832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe49ae4-8ab8-4386-88de-010bf21ac8d2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.767713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1113/2216] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:42.768773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d4385-3d99-4e12-8224-4ecd39846d51 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.779961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1104/2217] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:42 2022] PUT /identity/v3/projects/57f42be21f2e423eac11e66bd2ce42c8/users/9860ec7b2bfa484a86035e1d9461f56a/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:42.788541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe49ae4-8ab8-4386-88de-010bf21ac8d2 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:42.868661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d4385-3d99-4e12-8224-4ecd39846d51 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.896775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe49ae4-8ab8-4386-88de-010bf21ac8d2 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:42.908483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ba1e-3128-4dc7-8c85-f66c51e0eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:42.909198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ba1e-3128-4dc7-8c85-f66c51e0eeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.909546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ba1e-3128-4dc7-8c85-f66c51e0eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.909927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ba1e-3128-4dc7-8c85-f66c51e0eeb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.910821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2ba1e-3128-4dc7-8c85-f66c51e0eeb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:42.913065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2ba1e-3128-4dc7-8c85-f66c51e0eeb7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:42.948088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1105/2218] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:42.949755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a860-414d-47a1-b3a4-9409bb27d136 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:42.950149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a860-414d-47a1-b3a4-9409bb27d136 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:42.950579 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a860-414d-47a1-b3a4-9409bb27d136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:42.999760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e543a860-414d-47a1-b3a4-9409bb27d136 None None] MFA Rules not processed for user `9860ec7b2bfa484a86035e1d9461f56a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:43.002811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e543a860-414d-47a1-b3a4-9409bb27d136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:43.020916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682396-6c84-45c1-a811-dd0dce7e7b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.022743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682396-6c84-45c1-a811-dd0dce7e7b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.022927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682396-6c84-45c1-a811-dd0dce7e7b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.023125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682396-6c84-45c1-a811-dd0dce7e7b15 admin admin] PATH_INFO: `/v3/projects/267be57d716f424fb0fe2cf10b2648d8/users/33451bdfd7b941f898a7eb1b095c2965/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.091984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b682396-6c84-45c1-a811-dd0dce7e7b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267be57d716f424fb0fe2cf10b2648d8, user_id=33451bdfd7b941f898a7eb1b095c2965, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.097006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b682396-6c84-45c1-a811-dd0dce7e7b15 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.126684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:43.140252 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1114/2219] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:42 2022] PUT /identity/v3/projects/267be57d716f424fb0fe2cf10b2648d8/users/33451bdfd7b941f898a7eb1b095c2965/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:43.141503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682396-6c84-45c1-a811-dd0dce7e7b15 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.213565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1106/2220] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:43.215167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543a860-414d-47a1-b3a4-9409bb27d136 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.231552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:43.232716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543a860-414d-47a1-b3a4-9409bb27d136 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.320045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682396-6c84-45c1-a811-dd0dce7e7b15 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.332068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac1e8-4010-42a7-93ce-8ed943a71859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.334733 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac1e8-4010-42a7-93ce-8ed943a71859 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.335739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac1e8-4010-42a7-93ce-8ed943a71859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.336262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac1e8-4010-42a7-93ce-8ed943a71859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.337908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cac1e8-4010-42a7-93ce-8ed943a71859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.341368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cac1e8-4010-42a7-93ce-8ed943a71859 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.347134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609d43-bb88-40ee-80c1-9a3928265521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.349153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609d43-bb88-40ee-80c1-9a3928265521 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.349617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609d43-bb88-40ee-80c1-9a3928265521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.350201 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609d43-bb88-40ee-80c1-9a3928265521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.351325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609d43-bb88-40ee-80c1-9a3928265521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.354637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609d43-bb88-40ee-80c1-9a3928265521 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.357633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1115/2221] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:43.358731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac1e8-4010-42a7-93ce-8ed943a71859 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.375758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1107/2222] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:43.380403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609d43-bb88-40ee-80c1-9a3928265521 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.392733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609d43-bb88-40ee-80c1-9a3928265521 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.399838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3185a-50cb-434d-9fcb-476666e1f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.400955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3185a-50cb-434d-9fcb-476666e1f921 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.401478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3185a-50cb-434d-9fcb-476666e1f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.401643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3185a-50cb-434d-9fcb-476666e1f921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.402881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3185a-50cb-434d-9fcb-476666e1f921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.405493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3185a-50cb-434d-9fcb-476666e1f921 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.422067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1108/2223] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:43.423595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3185a-50cb-434d-9fcb-476666e1f921 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.438179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3185a-50cb-434d-9fcb-476666e1f921 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.444647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f89f3e-028b-4bdb-974c-0b9f94a1bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.445629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f89f3e-028b-4bdb-974c-0b9f94a1bbf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.445898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f89f3e-028b-4bdb-974c-0b9f94a1bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.446147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f89f3e-028b-4bdb-974c-0b9f94a1bbf7 admin admin] PATH_INFO: `/v3/projects/267be57d716f424fb0fe2cf10b2648d8/users/33451bdfd7b941f898a7eb1b095c2965/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.450525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f89f3e-028b-4bdb-974c-0b9f94a1bbf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267be57d716f424fb0fe2cf10b2648d8, user_id=33451bdfd7b941f898a7eb1b095c2965, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.453069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac1e8-4010-42a7-93ce-8ed943a71859 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.454042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f89f3e-028b-4bdb-974c-0b9f94a1bbf7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.475029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1109/2224] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:43 2022] PUT /identity/v3/projects/267be57d716f424fb0fe2cf10b2648d8/users/33451bdfd7b941f898a7eb1b095c2965/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:43.475029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f89f3e-028b-4bdb-974c-0b9f94a1bbf7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.481955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce53cb-5677-4e7d-86d5-31dfe4963ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.482737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce53cb-5677-4e7d-86d5-31dfe4963ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.483155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce53cb-5677-4e7d-86d5-31dfe4963ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.483665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce53cb-5677-4e7d-86d5-31dfe4963ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.566780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f89f3e-028b-4bdb-974c-0b9f94a1bbf7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.581270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8d16-2309-424e-a701-546073f0fab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.582349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8d16-2309-424e-a701-546073f0fab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.582632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8d16-2309-424e-a701-546073f0fab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.582913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8d16-2309-424e-a701-546073f0fab7 admin admin] PATH_INFO: `/v3/projects/2dcb127ee3184ea6a44d2e2af8fc52ab/users/f8a9929565fe44d680a0b2f7d8065b4b/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.609036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce53cb-5677-4e7d-86d5-31dfe4963ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.611936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce53cb-5677-4e7d-86d5-31dfe4963ed3 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.626153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1116/2225] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:43.627892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6344-47af-4a0c-bd28-3a1a53269591 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.628254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6344-47af-4a0c-bd28-3a1a53269591 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.636730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6344-47af-4a0c-bd28-3a1a53269591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.639257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b8d16-2309-424e-a701-546073f0fab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcb127ee3184ea6a44d2e2af8fc52ab, user_id=f8a9929565fe44d680a0b2f7d8065b4b, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.642762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b8d16-2309-424e-a701-546073f0fab7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.665806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c4ce6344-47af-4a0c-bd28-3a1a53269591 None None] MFA Rules not processed for user `33451bdfd7b941f898a7eb1b095c2965`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:43.667115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c4ce6344-47af-4a0c-bd28-3a1a53269591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:43.673125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1110/2226] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:43 2022] PUT /identity/v3/projects/2dcb127ee3184ea6a44d2e2af8fc52ab/users/f8a9929565fe44d680a0b2f7d8065b4b/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:43.679950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8fd49-6056-45f9-a3ec-8e09b2881371 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.680432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8fd49-6056-45f9-a3ec-8e09b2881371 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.680853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8fd49-6056-45f9-a3ec-8e09b2881371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.711744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e4b8fd49-6056-45f9-a3ec-8e09b2881371 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:43.712821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e4b8fd49-6056-45f9-a3ec-8e09b2881371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:43.769664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:43.788927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:43.802177 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1117/2227] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:43.817539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6344-47af-4a0c-bd28-3a1a53269591 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.819762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c4ce6344-47af-4a0c-bd28-3a1a53269591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:43.821392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1111/2228] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:43.829459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8fd49-6056-45f9-a3ec-8e09b2881371 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.833975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e4b8fd49-6056-45f9-a3ec-8e09b2881371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:43.921207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6344-47af-4a0c-bd28-3a1a53269591 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.925107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9346-8f7e-49db-892a-cf006a5b6d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.925828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9346-8f7e-49db-892a-cf006a5b6d04 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.926219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9346-8f7e-49db-892a-cf006a5b6d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.926536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9346-8f7e-49db-892a-cf006a5b6d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.937204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8fd49-6056-45f9-a3ec-8e09b2881371 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.946001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed9346-8f7e-49db-892a-cf006a5b6d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.948043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed9346-8f7e-49db-892a-cf006a5b6d04 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.953216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882bd64-4cfa-46b2-9fb1-c6c19de5d620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.954224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bd64-4cfa-46b2-9fb1-c6c19de5d620 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.958069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bd64-4cfa-46b2-9fb1-c6c19de5d620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.958622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bd64-4cfa-46b2-9fb1-c6c19de5d620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.969735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1118/2229] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:29:43.970577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9346-8f7e-49db-892a-cf006a5b6d04 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:43.971840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882bd64-4cfa-46b2-9fb1-c6c19de5d620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:43.973911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882bd64-4cfa-46b2-9fb1-c6c19de5d620 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:43.984893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9346-8f7e-49db-892a-cf006a5b6d04 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:43.990419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:43.991382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:43.991789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:43.992203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:43.993487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1112/2230] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:29:43.994837 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:44.034193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882bd64-4cfa-46b2-9fb1-c6c19de5d620 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:44.048659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882bd64-4cfa-46b2-9fb1-c6c19de5d620 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:44.056845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:44.057979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:44.058457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:44.059087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:44.063030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:44.086827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:44.089131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:44.102391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1119/2231] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:44.192786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:44.194517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:44.214442 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1113/2232] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:29:46.664059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:46.679407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164ff8-c5db-4376-a223-e24d0910adc6 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:46.688477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:46.689808 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:46.690422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:46.690846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] PATH_INFO: `/v3/users/b6dbc2fbd4b44c9b8dc4613cd58b6c04` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:46.692692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6dbc2fbd4b44c9b8dc4613cd58b6c04)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:46.695421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:46.755613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:46.770100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d281c-0ea2-43f5-a651-1ef71d415fb3 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:46.776436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:46.777699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:46.778048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:46.778654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:46.780961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:46.788565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6dbc2fbd4b44c9b8dc4613cd58b6c04'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:46.808902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6dbc2fbd4b44c9b8dc4613cd58b6c04'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:46.810047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6dbc2fbd4b44c9b8dc4613cd58b6c04'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:46.822632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6dbc2fbd4b44c9b8dc4613cd58b6c04'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:46.823648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-daf765cf-8fbf-40ab-89d8-593eed128468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6dbc2fbd4b44c9b8dc4613cd58b6c04'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:46.853022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1120/2233] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:46 2022] DELETE /identity/v3/users/b6dbc2fbd4b44c9b8dc4613cd58b6c04 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:46.860155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227820d-ee79-4964-b724-040302156626 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:46.860721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227820d-ee79-4964-b724-040302156626 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:46.861239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227820d-ee79-4964-b724-040302156626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:46.898384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:46.926431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d227820d-ee79-4964-b724-040302156626 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:46.929893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d227820d-ee79-4964-b724-040302156626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:46.938410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:46.941633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:46.967573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1114/2234] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:47.093765 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1121/2235] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:47.104006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:47.128584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760be3e-b851-416f-9ac3-d90b23745a88 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:47.163227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:47.306064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca890c-04d8-4a0f-a1c2-b5545848bd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:47.310043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca890c-04d8-4a0f-a1c2-b5545848bd76 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:47.310370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca890c-04d8-4a0f-a1c2-b5545848bd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:47.310809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca890c-04d8-4a0f-a1c2-b5545848bd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:47.335172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca890c-04d8-4a0f-a1c2-b5545848bd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:47.337031 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca890c-04d8-4a0f-a1c2-b5545848bd76 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:47.364421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1115/2236] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:48.119311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227820d-ee79-4964-b724-040302156626 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:48.121207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d227820d-ee79-4964-b724-040302156626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:48.143690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227820d-ee79-4964-b724-040302156626 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:48.167027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:48.167999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:48.168318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:48.168706 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] PATH_INFO: `/v3/users/7e88ea056e024c6f9d8a52b8eca12741` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:48.171422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e88ea056e024c6f9d8a52b8eca12741)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:48.174315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:48.276648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e88ea056e024c6f9d8a52b8eca12741'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.296796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e88ea056e024c6f9d8a52b8eca12741'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.298542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e88ea056e024c6f9d8a52b8eca12741'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.313813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e88ea056e024c6f9d8a52b8eca12741'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.324392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e88ea056e024c6f9d8a52b8eca12741'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.355133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1122/2237] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:48 2022] DELETE /identity/v3/users/7e88ea056e024c6f9d8a52b8eca12741 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:48.360879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16096-07d7-478f-8414-100e8bd6d08a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:48.361980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16096-07d7-478f-8414-100e8bd6d08a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:48.362585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16096-07d7-478f-8414-100e8bd6d08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:48.399390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4bc16096-07d7-478f-8414-100e8bd6d08a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:48.400853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4bc16096-07d7-478f-8414-100e8bd6d08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:48.468024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:48.469980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:48.538006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1116/2238] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:48.552610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16096-07d7-478f-8414-100e8bd6d08a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:48.554760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4bc16096-07d7-478f-8414-100e8bd6d08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:48.599191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39583e8-c830-4687-af46-de48d6ed5409 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:48.606383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:48.608112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:48.608700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:48.609249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] PATH_INFO: `/v3/projects/2072142328e6454683e99c6e5e1495b0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:48.611321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2072142328e6454683e99c6e5e1495b0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:48.613715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:48.657014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16096-07d7-478f-8414-100e8bd6d08a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:48.662451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec920e43-e528-4239-a602-41422dc61e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:48.663163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec920e43-e528-4239-a602-41422dc61e59 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:48.663443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec920e43-e528-4239-a602-41422dc61e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:48.663712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec920e43-e528-4239-a602-41422dc61e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:48.667173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:48.685297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec920e43-e528-4239-a602-41422dc61e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:48.688075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec920e43-e528-4239-a602-41422dc61e59 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:48.705723 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1117/2239] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:29:48.733777 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2072142328e6454683e99c6e5e1495b0', 'request_id': 'req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.748873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2072142328e6454683e99c6e5e1495b0', 'request_id': 'req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.769135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2072142328e6454683e99c6e5e1495b0', 'request_id': 'req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.789151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] The token cache is being invalidate because project 2072142328e6454683e99c6e5e1495b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:48.789151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.790233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-40c4dbe1-4fd5-40fe-8121-1aa6b18fcf24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:48.795956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1123/2240] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:48 2022] DELETE /identity/v3/projects/2072142328e6454683e99c6e5e1495b0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:48.798821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e192-f2ba-4b8a-875a-49b60025c721 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:48.799155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e192-f2ba-4b8a-875a-49b60025c721 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:48.799434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e192-f2ba-4b8a-875a-49b60025c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:48.839139 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1ee7e192-f2ba-4b8a-875a-49b60025c721 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:48.840945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1ee7e192-f2ba-4b8a-875a-49b60025c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:48.932369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:48.957717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1118/2241] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:48.966240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d60958-9ebd-4963-b5fd-37922afcc2e1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:48.966636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d60958-9ebd-4963-b5fd-37922afcc2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:48.967059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d60958-9ebd-4963-b5fd-37922afcc2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:48.995657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-69d60958-9ebd-4963-b5fd-37922afcc2e1 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:48.998874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-69d60958-9ebd-4963-b5fd-37922afcc2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:49.015103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1124/2242] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:49.016816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7e192-f2ba-4b8a-875a-49b60025c721 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.032922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7e192-f2ba-4b8a-875a-49b60025c721 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:49.041217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:49.042079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.043554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.044343 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.045597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:49.045842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:49.048853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:49.070040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1119/2243] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:49.074371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d60958-9ebd-4963-b5fd-37922afcc2e1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.085949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d60958-9ebd-4963-b5fd-37922afcc2e1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:49.098309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:49.099043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.099325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.099597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.100310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:49.102231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:49.164179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1125/2244] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:49 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:49.168534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.180157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93058d68-eae0-4cee-8bcf-83fa5dd63b90 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:49.231391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.233475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:49.366734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de2fc-ec5e-4916-aae9-3fd8f5de6452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:49.367573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de2fc-ec5e-4916-aae9-3fd8f5de6452 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.367857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de2fc-ec5e-4916-aae9-3fd8f5de6452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.368130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de2fc-ec5e-4916-aae9-3fd8f5de6452 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.368857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de2fc-ec5e-4916-aae9-3fd8f5de6452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:49.370919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de2fc-ec5e-4916-aae9-3fd8f5de6452 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:49.415102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1120/2245] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:49 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:49.415339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd5df9-02e8-46a5-9c6f-cf1a100de7e0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:49.426108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de2fc-ec5e-4916-aae9-3fd8f5de6452 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.433998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:49.434861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.435175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.435452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] PATH_INFO: `/v3/projects/6f8f734ea2284fed9e1335827ba00cec` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.437923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8f734ea2284fed9e1335827ba00cec)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:49.440445 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:49.440600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de2fc-ec5e-4916-aae9-3fd8f5de6452 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:49.448558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637006b6-9c02-46d8-b9d8-a7883b5d4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:49.449256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637006b6-9c02-46d8-b9d8-a7883b5d4671 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.449685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637006b6-9c02-46d8-b9d8-a7883b5d4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.450095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637006b6-9c02-46d8-b9d8-a7883b5d4671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.450760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637006b6-9c02-46d8-b9d8-a7883b5d4671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:49.452585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637006b6-9c02-46d8-b9d8-a7883b5d4671 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:49.482030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1121/2246] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:49.485862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637006b6-9c02-46d8-b9d8-a7883b5d4671 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.499525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637006b6-9c02-46d8-b9d8-a7883b5d4671 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:49.510285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec6630-8f1d-4d26-a075-fe7c5ac399d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:49.511466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec6630-8f1d-4d26-a075-fe7c5ac399d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.511687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec6630-8f1d-4d26-a075-fe7c5ac399d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.512020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec6630-8f1d-4d26-a075-fe7c5ac399d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.514561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec6630-8f1d-4d26-a075-fe7c5ac399d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:49.524501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec6630-8f1d-4d26-a075-fe7c5ac399d9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:49.552631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1122/2247] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:29:49.553696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8f734ea2284fed9e1335827ba00cec', 'request_id': 'req-b50cabac-cb17-457c-ad58-f3bbe17c327d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:49.556920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec6630-8f1d-4d26-a075-fe7c5ac399d9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.568276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8f734ea2284fed9e1335827ba00cec', 'request_id': 'req-b50cabac-cb17-457c-ad58-f3bbe17c327d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:49.570911 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec6630-8f1d-4d26-a075-fe7c5ac399d9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:49.577710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8f734ea2284fed9e1335827ba00cec', 'request_id': 'req-b50cabac-cb17-457c-ad58-f3bbe17c327d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:49.595712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] The token cache is being invalidate because project 6f8f734ea2284fed9e1335827ba00cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:49.596077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:49.597436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:49.602675 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1126/2248] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:49 2022] DELETE /identity/v3/projects/6f8f734ea2284fed9e1335827ba00cec => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:49.604019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.606478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:49.627967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:49.695422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5b0f-93c5-481c-86e0-75de1c08948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:49.696341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5b0f-93c5-481c-86e0-75de1c08948a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.697106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5b0f-93c5-481c-86e0-75de1c08948a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.697106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5b0f-93c5-481c-86e0-75de1c08948a admin admin] PATH_INFO: `/v3/projects/a71c9cbae3f1476c93ce86691432f94f/users/11131c17495241d0af15ed5d984ab1b1/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.715037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5b0f-93c5-481c-86e0-75de1c08948a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71c9cbae3f1476c93ce86691432f94f, user_id=11131c17495241d0af15ed5d984ab1b1, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:49.719045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5b0f-93c5-481c-86e0-75de1c08948a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:49.751028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1123/2249] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:49 2022] PUT /identity/v3/projects/a71c9cbae3f1476c93ce86691432f94f/users/11131c17495241d0af15ed5d984ab1b1/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:49.753353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce488-bccd-4a3b-b322-2734b74ea43f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.753656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce488-bccd-4a3b-b322-2734b74ea43f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.753961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce488-bccd-4a3b-b322-2734b74ea43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.755683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cabac-cb17-457c-ad58-f3bbe17c327d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:49.797422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b00ce488-bccd-4a3b-b322-2734b74ea43f None None] MFA Rules not processed for user `11131c17495241d0af15ed5d984ab1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:49.799420 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b00ce488-bccd-4a3b-b322-2734b74ea43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:49.844262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:49.865160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:49.866852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:49.867499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:49.868027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] PATH_INFO: `/v3/users/5fa7ec72d4a14f3db50c54e7e64b742b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:49.899563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa7ec72d4a14f3db50c54e7e64b742b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:49.903921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:49.937845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1124/2250] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:49.949568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce488-bccd-4a3b-b322-2734b74ea43f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:49.953890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b00ce488-bccd-4a3b-b322-2734b74ea43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:50.015528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa7ec72d4a14f3db50c54e7e64b742b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.059005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa7ec72d4a14f3db50c54e7e64b742b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.059258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa7ec72d4a14f3db50c54e7e64b742b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.071702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa7ec72d4a14f3db50c54e7e64b742b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.073800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa7ec72d4a14f3db50c54e7e64b742b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.081523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce488-bccd-4a3b-b322-2734b74ea43f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:50.094005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c87c1-d1bd-4e98-8364-c7adc376068b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:50.094848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c87c1-d1bd-4e98-8364-c7adc376068b service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:50.097397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c87c1-d1bd-4e98-8364-c7adc376068b service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:50.098000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c87c1-d1bd-4e98-8364-c7adc376068b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:50.102934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d00c87c1-d1bd-4e98-8364-c7adc376068b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:50.108089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1127/2251] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:49 2022] DELETE /identity/v3/users/5fa7ec72d4a14f3db50c54e7e64b742b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:50.120812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c87c1-d1bd-4e98-8364-c7adc376068b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:50.123187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c87c1-d1bd-4e98-8364-c7adc376068b service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:50.146076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1125/2252] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:50.384261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:50.385826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:50.494741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:50.548669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f7315-5f54-4f56-95f6-b023cd9652a8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:50.574873 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:50.576014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:50.576301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:50.576582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] PATH_INFO: `/v3/users/8f3da3cca6e540bd8a1b3b27b1b9def0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:50.580289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3da3cca6e540bd8a1b3b27b1b9def0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:50.584363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9106fc-a499-4f08-a582-f277cb00f72b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:50.585202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9106fc-a499-4f08-a582-f277cb00f72b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:50.585202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9106fc-a499-4f08-a582-f277cb00f72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:50.597713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:50.657205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1e9106fc-a499-4f08-a582-f277cb00f72b None None] MFA Rules not processed for user `f8a9929565fe44d680a0b2f7d8065b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:50.659078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1e9106fc-a499-4f08-a582-f277cb00f72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:50.735646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3da3cca6e540bd8a1b3b27b1b9def0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.801153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3da3cca6e540bd8a1b3b27b1b9def0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.803596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3da3cca6e540bd8a1b3b27b1b9def0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.823709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3da3cca6e540bd8a1b3b27b1b9def0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.825262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-708f1ec0-8a78-4335-80d6-88e18ae68487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3da3cca6e540bd8a1b3b27b1b9def0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:50.862302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1126/2253] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:50.864850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacd73a-9e9e-4081-9948-f0990176f445 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:50.866382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacd73a-9e9e-4081-9948-f0990176f445 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:50.867400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacd73a-9e9e-4081-9948-f0990176f445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:50.875915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1128/2254] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:50 2022] DELETE /identity/v3/users/8f3da3cca6e540bd8a1b3b27b1b9def0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:50.881697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e74e-522e-4f43-8c67-b1efc145fbb2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:50.882037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e74e-522e-4f43-8c67-b1efc145fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:50.882264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e74e-522e-4f43-8c67-b1efc145fbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:50.921197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cdacd73a-9e9e-4081-9948-f0990176f445 None None] MFA Rules not processed for user `f8a9929565fe44d680a0b2f7d8065b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:50.923925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cdacd73a-9e9e-4081-9948-f0990176f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:50.950574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-23c9e74e-522e-4f43-8c67-b1efc145fbb2 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:50.951854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23c9e74e-522e-4f43-8c67-b1efc145fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.012696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1127/2255] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:51.021113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacd73a-9e9e-4081-9948-f0990176f445 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:51.022520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cdacd73a-9e9e-4081-9948-f0990176f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.048107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:51.128856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1129/2256] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:51.129903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e74e-522e-4f43-8c67-b1efc145fbb2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:51.131412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23c9e74e-522e-4f43-8c67-b1efc145fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.160742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e74e-522e-4f43-8c67-b1efc145fbb2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:51.166020 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:51.167015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:51.167536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:51.167907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] PATH_INFO: `/v3/projects/14128a9bc80b451d8b9342757b5b7da6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:51.169324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] RBAC: Authorizing `identity:delete_project(project_id=14128a9bc80b451d8b9342757b5b7da6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:51.176622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:51.299454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacd73a-9e9e-4081-9948-f0990176f445 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:51.330151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14128a9bc80b451d8b9342757b5b7da6', 'request_id': 'req-1f244e3a-21e5-4a26-8961-9e1e6181780b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.338553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:51.350954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14128a9bc80b451d8b9342757b5b7da6', 'request_id': 'req-1f244e3a-21e5-4a26-8961-9e1e6181780b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.364998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14128a9bc80b451d8b9342757b5b7da6', 'request_id': 'req-1f244e3a-21e5-4a26-8961-9e1e6181780b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.398998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] The token cache is being invalidate because project 14128a9bc80b451d8b9342757b5b7da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:51.399729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.400186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.406329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1130/2257] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:51 2022] DELETE /identity/v3/projects/14128a9bc80b451d8b9342757b5b7da6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:51.407431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:51.409581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.420033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:51.421744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:51.421744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:51.422133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] PATH_INFO: `/v3/users/3106727234a342d5be83a6af6e5ca055` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:51.423834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3106727234a342d5be83a6af6e5ca055)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:51.426730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:51.497895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3106727234a342d5be83a6af6e5ca055'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.515322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3106727234a342d5be83a6af6e5ca055'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.516629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3106727234a342d5be83a6af6e5ca055'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.516854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3106727234a342d5be83a6af6e5ca055'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.517269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244e3a-21e5-4a26-8961-9e1e6181780b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:51.524276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:51.525107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:51.525325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3106727234a342d5be83a6af6e5ca055'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.525489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:51.525818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:51.528326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.542207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1128/2258] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:51 2022] DELETE /identity/v3/users/3106727234a342d5be83a6af6e5ca055 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:51.544001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:51.545925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.586808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:51.598056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:51.600045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:51.611132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1131/2259] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:51.611865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:51.613536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.618714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49242-130d-4e05-9fb4-d1ec5248818d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:51.623969 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fb626-0677-4a65-9246-0f594f785b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:51.624744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb626-0677-4a65-9246-0f594f785b7c service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:51.625014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb626-0677-4a65-9246-0f594f785b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:51.625447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fb626-0677-4a65-9246-0f594f785b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:51.627378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-027fb626-0677-4a65-9246-0f594f785b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.630095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fe9d3-29c0-4170-b94b-a2ca8adf6543 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:51.722090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:51.723227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:51.723579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:51.723923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] PATH_INFO: `/v3/users/33451bdfd7b941f898a7eb1b095c2965` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:51.726084 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33451bdfd7b941f898a7eb1b095c2965)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:51.729081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:51.784430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fb626-0677-4a65-9246-0f594f785b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:51.785952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fb626-0677-4a65-9246-0f594f785b7c service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:51.790039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:51.798623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1129/2260] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:51.802016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee725-c5a5-40ff-9bfb-af15bc2f60e1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:51.802016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee725-c5a5-40ff-9bfb-af15bc2f60e1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:51.802016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee725-c5a5-40ff-9bfb-af15bc2f60e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:51.827670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e35ee725-c5a5-40ff-9bfb-af15bc2f60e1 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:51.828926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e35ee725-c5a5-40ff-9bfb-af15bc2f60e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.845651 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1130/2261] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:51.851347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33451bdfd7b941f898a7eb1b095c2965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.861342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ee725-c5a5-40ff-9bfb-af15bc2f60e1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:51.867683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33451bdfd7b941f898a7eb1b095c2965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.868835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33451bdfd7b941f898a7eb1b095c2965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.874543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ee725-c5a5-40ff-9bfb-af15bc2f60e1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:51.883132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33451bdfd7b941f898a7eb1b095c2965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.883958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33451bdfd7b941f898a7eb1b095c2965'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:51.884728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:51.885896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:51.886261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:51.886539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:51.891965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:51.900846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1132/2262] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:51 2022] DELETE /identity/v3/users/33451bdfd7b941f898a7eb1b095c2965 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:51.933122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:51.934891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:51.949054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1131/2263] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:29:52.791661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:52.793213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:52.903028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:52.909415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:52.936993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740adf-62ba-4827-8d6c-2edf15de9531 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:52.990364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16e502-cc4f-46a1-a22e-f773a28a6e92 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:52.997501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:52.997501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:52.997967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:52.998319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] PATH_INFO: `/v3/projects/8bfe3d2b47cd451cb939e106ddbe5514` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:52.999997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfe3d2b47cd451cb939e106ddbe5514)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:53.002707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:53.099916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:53.100762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:53.101046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:53.101318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] PATH_INFO: `/v3/projects/59f717850d00405a8044dc3b4db393ab` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:53.103634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f717850d00405a8044dc3b4db393ab)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:53.108006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:53.125878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfe3d2b47cd451cb939e106ddbe5514', 'request_id': 'req-ceec2f46-8748-4b56-abbd-7f709de698e3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.142773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfe3d2b47cd451cb939e106ddbe5514', 'request_id': 'req-ceec2f46-8748-4b56-abbd-7f709de698e3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.153600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfe3d2b47cd451cb939e106ddbe5514', 'request_id': 'req-ceec2f46-8748-4b56-abbd-7f709de698e3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.175260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] The token cache is being invalidate because project 8bfe3d2b47cd451cb939e106ddbe5514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:53.176457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.177685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.181417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1133/2264] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:52 2022] DELETE /identity/v3/projects/8bfe3d2b47cd451cb939e106ddbe5514 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:53.183847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:53.187584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:53.251735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:53.265224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f717850d00405a8044dc3b4db393ab', 'request_id': 'req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.290386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f717850d00405a8044dc3b4db393ab', 'request_id': 'req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.303998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:53.306308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f717850d00405a8044dc3b4db393ab', 'request_id': 'req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.325435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2f46-8748-4b56-abbd-7f709de698e3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:53.335039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] The token cache is being invalidate because project 59f717850d00405a8044dc3b4db393ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:53.335664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.354310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b26bbbe6-8b45-434f-9e32-6a2ef291adc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.358275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1132/2265] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:52 2022] DELETE /identity/v3/projects/59f717850d00405a8044dc3b4db393ab => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:53.365634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85105-7a4a-466d-8a27-fce60da4e0de None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:53.366078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85105-7a4a-466d-8a27-fce60da4e0de None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:53.366528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85105-7a4a-466d-8a27-fce60da4e0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:53.400057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5cd85105-7a4a-466d-8a27-fce60da4e0de None None] MFA Rules not processed for user `f8a9929565fe44d680a0b2f7d8065b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:53.402137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5cd85105-7a4a-466d-8a27-fce60da4e0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:53.480628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:53.482347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:53.482945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:53.483571 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] PATH_INFO: `/v3/projects/267be57d716f424fb0fe2cf10b2648d8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:53.486323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=267be57d716f424fb0fe2cf10b2648d8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:53.494619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:53.522259 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1133/2266] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:53.524970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd85105-7a4a-466d-8a27-fce60da4e0de None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:53.539408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5cd85105-7a4a-466d-8a27-fce60da4e0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:53.569519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd85105-7a4a-466d-8a27-fce60da4e0de None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:53.577314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:53.578707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:53.579195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:53.579699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] PATH_INFO: `/v3/users/270768294515496bbd66f4376571bd46` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:53.582580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270768294515496bbd66f4376571bd46)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:53.586170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:53.649467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267be57d716f424fb0fe2cf10b2648d8', 'request_id': 'req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.684565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267be57d716f424fb0fe2cf10b2648d8', 'request_id': 'req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.704679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267be57d716f424fb0fe2cf10b2648d8', 'request_id': 'req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.726605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] The token cache is being invalidate because project 267be57d716f424fb0fe2cf10b2648d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:53.727215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.728321 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.731770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1134/2267] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:53 2022] DELETE /identity/v3/projects/267be57d716f424fb0fe2cf10b2648d8 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:53.733442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:53.735646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:53.742733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270768294515496bbd66f4376571bd46'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.783932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270768294515496bbd66f4376571bd46'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.788635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270768294515496bbd66f4376571bd46'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.790531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270768294515496bbd66f4376571bd46'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.818040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-8b2318d3-1cf9-488a-a0a1-1f3cadf85239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270768294515496bbd66f4376571bd46'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:53.862068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1134/2268] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:53 2022] DELETE /identity/v3/users/270768294515496bbd66f4376571bd46 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:53.867854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49099f-4603-4c21-a861-74775cf09fff None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:53.868527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49099f-4603-4c21-a861-74775cf09fff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:53.869015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49099f-4603-4c21-a861-74775cf09fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:53.951681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-0b49099f-4603-4c21-a861-74775cf09fff None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:53.960558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0b49099f-4603-4c21-a861-74775cf09fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:54.080093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7f1c2-ed86-4201-9ff6-16a7c4b12d1b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:54.115772 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:54.207032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1135/2269] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:54.208691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b49c-0e4f-4b13-8427-c6ef9cd63d4f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:54.209066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b49c-0e4f-4b13-8427-c6ef9cd63d4f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:54.209501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b49c-0e4f-4b13-8427-c6ef9cd63d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:54.263338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e223b49c-0e4f-4b13-8427-c6ef9cd63d4f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:54.275136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e223b49c-0e4f-4b13-8427-c6ef9cd63d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:54.293055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:54.293567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:54.293889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:54.294162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] PATH_INFO: `/v3/users/9860ec7b2bfa484a86035e1d9461f56a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:54.296147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1136/2270] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:29:54.300461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223b49c-0e4f-4b13-8427-c6ef9cd63d4f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:54.301298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9860ec7b2bfa484a86035e1d9461f56a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:54.310757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:54.316618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:54.331351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223b49c-0e4f-4b13-8427-c6ef9cd63d4f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:54.345726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:54.346759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:54.347355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:54.347648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:54.348823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:54.349318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:54.362462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:54.391592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1137/2271] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:29:54.396533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:54.406395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbf252-e8e3-46e3-9f16-a559da2dde90 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:54.412070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:54.412756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:54.413048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:54.413325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:54.414263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:54.419062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:54.437149 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9860ec7b2bfa484a86035e1d9461f56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:54.461308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9860ec7b2bfa484a86035e1d9461f56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:54.462426 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9860ec7b2bfa484a86035e1d9461f56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:54.473140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1138/2272] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:54 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:54.477941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:54.483797 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9860ec7b2bfa484a86035e1d9461f56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:54.485535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9860ec7b2bfa484a86035e1d9461f56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:54.488212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:54.527337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1135/2273] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:53 2022] DELETE /identity/v3/users/9860ec7b2bfa484a86035e1d9461f56a => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:54.635150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2283-3850-4d16-b461-d3b7bc5ff55b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:54.785951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484418b-8d01-453a-a273-10f8ac792d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:54.789365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484418b-8d01-453a-a273-10f8ac792d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:54.790429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484418b-8d01-453a-a273-10f8ac792d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:54.791398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484418b-8d01-453a-a273-10f8ac792d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:54.793153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484418b-8d01-453a-a273-10f8ac792d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:54.797708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484418b-8d01-453a-a273-10f8ac792d5c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:54.809851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:54.811639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:54.838246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ec07c-2aa7-419d-b149-02fe36907df9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:54.851151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:54.852307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:54.852732 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:54.853153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] PATH_INFO: `/v3/projects/1c255f1fcb7e47ca951bea03f4ae3657` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:54.856872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c255f1fcb7e47ca951bea03f4ae3657)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:54.857999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1139/2274] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:54 2022] POST /identity/v3/users => generated 292 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:54.861891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:54.863653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484418b-8d01-453a-a273-10f8ac792d5c admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:54.886916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484418b-8d01-453a-a273-10f8ac792d5c admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:54.904958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf4a79-003c-478b-bdde-2de49ccbfeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:54.906017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf4a79-003c-478b-bdde-2de49ccbfeac admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:54.906268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf4a79-003c-478b-bdde-2de49ccbfeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:54.906640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf4a79-003c-478b-bdde-2de49ccbfeac admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:54.907716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf4a79-003c-478b-bdde-2de49ccbfeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:54.909923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf4a79-003c-478b-bdde-2de49ccbfeac admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:54.934924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1140/2275] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:29:54.937841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf4a79-003c-478b-bdde-2de49ccbfeac admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:54.967189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c255f1fcb7e47ca951bea03f4ae3657', 'request_id': 'req-7e396dc5-a25b-4ef0-91fb-a0ec15244600'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:54.975748 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf4a79-003c-478b-bdde-2de49ccbfeac admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:54.979332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c255f1fcb7e47ca951bea03f4ae3657', 'request_id': 'req-7e396dc5-a25b-4ef0-91fb-a0ec15244600'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.008603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c255f1fcb7e47ca951bea03f4ae3657', 'request_id': 'req-7e396dc5-a25b-4ef0-91fb-a0ec15244600'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.043169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] The token cache is being invalidate because project 1c255f1fcb7e47ca951bea03f4ae3657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:55.043597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.044719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.046835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1136/2276] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:54 2022] DELETE /identity/v3/projects/1c255f1fcb7e47ca951bea03f4ae3657 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:55.061974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:55.068140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:55.091880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:55.103699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:55.112052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:55.112369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:55.112520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:55.113199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:55.114857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:55.115573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:55.135932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1141/2277] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:55.137096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:55.145832 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:55.164665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb8da1-c445-4387-a687-9decdca6eabc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:55.187080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c025ae-3f6f-452e-84de-068773ab3ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:55.187080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c025ae-3f6f-452e-84de-068773ab3ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:55.187080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c025ae-3f6f-452e-84de-068773ab3ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:55.187080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c025ae-3f6f-452e-84de-068773ab3ed9 admin admin] PATH_INFO: `/v3/projects/e7998889112748bb98c6f514404dbaae/users/4695141c1dab4bb9b1decabac112f4dd/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:55.204370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c025ae-3f6f-452e-84de-068773ab3ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7998889112748bb98c6f514404dbaae, user_id=4695141c1dab4bb9b1decabac112f4dd, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:55.207039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c025ae-3f6f-452e-84de-068773ab3ed9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:55.233737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1142/2278] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:55 2022] PUT /identity/v3/projects/e7998889112748bb98c6f514404dbaae/users/4695141c1dab4bb9b1decabac112f4dd/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:29:55.248593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368dfa9-175b-4387-99b5-9689ec488e7d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:55.249102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368dfa9-175b-4387-99b5-9689ec488e7d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:55.249524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368dfa9-175b-4387-99b5-9689ec488e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:55.264483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e396dc5-a25b-4ef0-91fb-a0ec15244600 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:55.292394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c368dfa9-175b-4387-99b5-9689ec488e7d None None] MFA Rules not processed for user `4695141c1dab4bb9b1decabac112f4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:55.293895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c368dfa9-175b-4387-99b5-9689ec488e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:55.386958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:55.389205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:55.391371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:55.393947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] PATH_INFO: `/v3/users/0664b4accf0f4aa3baa7b38964d89bc7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:55.397982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0664b4accf0f4aa3baa7b38964d89bc7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:55.404995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:55.461332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1143/2279] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:55.462696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368dfa9-175b-4387-99b5-9689ec488e7d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:55.478693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368dfa9-175b-4387-99b5-9689ec488e7d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:55.492221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:55.493336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:55.495160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:55.495673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:55.497653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:55.503826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:55.516568 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0664b4accf0f4aa3baa7b38964d89bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.549018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0664b4accf0f4aa3baa7b38964d89bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.550176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0664b4accf0f4aa3baa7b38964d89bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.565448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0664b4accf0f4aa3baa7b38964d89bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.568052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1144/2280] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:55 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:55.572275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:55.573225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0664b4accf0f4aa3baa7b38964d89bc7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:55.576982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:55.610816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1137/2281] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:55 2022] DELETE /identity/v3/users/0664b4accf0f4aa3baa7b38964d89bc7 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:55.765253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11937752-bf7d-40b5-a81a-48dba333c351 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:55.881694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:55.883262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:55.897069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:55.951390 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0150dc8-c69f-40a8-b65c-44cd2f2f9830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:55.952777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150dc8-c69f-40a8-b65c-44cd2f2f9830 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:55.953165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150dc8-c69f-40a8-b65c-44cd2f2f9830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:55.953544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150dc8-c69f-40a8-b65c-44cd2f2f9830 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:55.954477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0150dc8-c69f-40a8-b65c-44cd2f2f9830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:55.959210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0150dc8-c69f-40a8-b65c-44cd2f2f9830 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:56.035618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1145/2282] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:55 2022] POST /identity/v3/users => generated 298 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:29:56.046330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0150dc8-c69f-40a8-b65c-44cd2f2f9830 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:56.077248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0150dc8-c69f-40a8-b65c-44cd2f2f9830 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:56.094877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:56.107717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde78ea5-d6ac-4a07-8062-a018c7a3d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:56.107717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78ea5-d6ac-4a07-8062-a018c7a3d485 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:56.107717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78ea5-d6ac-4a07-8062-a018c7a3d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:56.107717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78ea5-d6ac-4a07-8062-a018c7a3d485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:56.108432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde78ea5-d6ac-4a07-8062-a018c7a3d485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:56.128333 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde78ea5-d6ac-4a07-8062-a018c7a3d485 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:56.167041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1146/2283] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:56.176490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde78ea5-d6ac-4a07-8062-a018c7a3d485 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:56.193275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb391c61-ec60-4f07-81d6-60e49dcf80d1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:56.202437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde78ea5-d6ac-4a07-8062-a018c7a3d485 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:56.210784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:56.213868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:56.214231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:56.214935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] PATH_INFO: `/v3/projects/57f42be21f2e423eac11e66bd2ce42c8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:56.218660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f42be21f2e423eac11e66bd2ce42c8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:56.224608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:56.226160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:56.226627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:56.227081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] PATH_INFO: `/v3/projects/864f96c99a3b4646b05cb00b09c73da0/users/0dcb7183aaf34ff8aa07cb72905673f7/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:56.229077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:56.275912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=864f96c99a3b4646b05cb00b09c73da0, user_id=0dcb7183aaf34ff8aa07cb72905673f7, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:56.282927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:56.320953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1147/2284] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:56 2022] PUT /identity/v3/projects/864f96c99a3b4646b05cb00b09c73da0/users/0dcb7183aaf34ff8aa07cb72905673f7/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:56.321983 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:56.335202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:56.400836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f42be21f2e423eac11e66bd2ce42c8', 'request_id': 'req-376c427f-a5cd-4533-935d-a92253cad43c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:56.414718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f42be21f2e423eac11e66bd2ce42c8', 'request_id': 'req-376c427f-a5cd-4533-935d-a92253cad43c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:56.424303 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f42be21f2e423eac11e66bd2ce42c8', 'request_id': 'req-376c427f-a5cd-4533-935d-a92253cad43c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:56.442120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] The token cache is being invalidate because project 57f42be21f2e423eac11e66bd2ce42c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:56.442607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:56.444052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:56.451069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1138/2285] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:55 2022] DELETE /identity/v3/projects/57f42be21f2e423eac11e66bd2ce42c8 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:56.452484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:56.454142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:56.504118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e269692-c094-427c-8d2c-6a826bae7f4a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:56.652627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:56.658502 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:56.660569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:56.660888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:56.672455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:56.694092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c427f-a5cd-4533-935d-a92253cad43c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:56.708461 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5df60-3386-4001-b7b5-c78885cfe6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:56.713316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5df60-3386-4001-b7b5-c78885cfe6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:56.713619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5df60-3386-4001-b7b5-c78885cfe6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:56.713954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5df60-3386-4001-b7b5-c78885cfe6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:56.714647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5df60-3386-4001-b7b5-c78885cfe6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:56.721789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5df60-3386-4001-b7b5-c78885cfe6c3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:56.770793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1139/2286] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:56.778727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678e47-a680-43eb-84ec-bb22ff647667 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:56.781410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678e47-a680-43eb-84ec-bb22ff647667 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:56.781891 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678e47-a680-43eb-84ec-bb22ff647667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:56.859743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-76678e47-a680-43eb-84ec-bb22ff647667 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:56.864841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-76678e47-a680-43eb-84ec-bb22ff647667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:56.888875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1140/2287] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:56.899722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76678e47-a680-43eb-84ec-bb22ff647667 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:56.903924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-76678e47-a680-43eb-84ec-bb22ff647667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:56.929934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:56.930859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76678e47-a680-43eb-84ec-bb22ff647667 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:56.936906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:56.945716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:56.951984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:56.953284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:56.953532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:56.953806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] PATH_INFO: `/v3/users/11131c17495241d0af15ed5d984ab1b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:56.955793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=11131c17495241d0af15ed5d984ab1b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:56.963724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:56.971499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1148/2288] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:56.972499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:56.975109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:56.995769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220674f-8b2b-4ca9-9b1a-2bbde92d55b5 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:57.007926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:57.009083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:57.009515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:57.009934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] PATH_INFO: `/v3/projects/bb459fc31e4d4b6ca064a9f420ef5527` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:57.012049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb459fc31e4d4b6ca064a9f420ef5527)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:57.014323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:57.094617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb459fc31e4d4b6ca064a9f420ef5527', 'request_id': 'req-4e0e6bd4-ffdf-47d6-816c-3448126072f9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.100329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11131c17495241d0af15ed5d984ab1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.110833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb459fc31e4d4b6ca064a9f420ef5527', 'request_id': 'req-4e0e6bd4-ffdf-47d6-816c-3448126072f9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.112786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:57.125716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb459fc31e4d4b6ca064a9f420ef5527', 'request_id': 'req-4e0e6bd4-ffdf-47d6-816c-3448126072f9'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.134028 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11131c17495241d0af15ed5d984ab1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.134956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11131c17495241d0af15ed5d984ab1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.146669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] The token cache is being invalidate because project bb459fc31e4d4b6ca064a9f420ef5527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:57.147480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.148394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.150636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1149/2289] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:56 2022] DELETE /identity/v3/projects/bb459fc31e4d4b6ca064a9f420ef5527 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:57.151696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:57.156409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11131c17495241d0af15ed5d984ab1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.157156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3060022-c2e5-4094-b29b-3960f5f8ec4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11131c17495241d0af15ed5d984ab1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:57.167137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:57.181962 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1141/2290] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:29:56 2022] DELETE /identity/v3/users/11131c17495241d0af15ed5d984ab1b1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:57.186115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be5a1-363d-4e7e-8d34-9da140cfab0c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:57.186405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be5a1-363d-4e7e-8d34-9da140cfab0c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:57.187257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be5a1-363d-4e7e-8d34-9da140cfab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:57.264539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8b4be5a1-363d-4e7e-8d34-9da140cfab0c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:57.271276 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8b4be5a1-363d-4e7e-8d34-9da140cfab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:57.301740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e6bd4-ffdf-47d6-816c-3448126072f9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:57.441153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617cb98-0899-4a05-bb78-e6c45e674687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:57.442369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617cb98-0899-4a05-bb78-e6c45e674687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:57.442749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617cb98-0899-4a05-bb78-e6c45e674687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:57.443162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617cb98-0899-4a05-bb78-e6c45e674687 admin admin] PATH_INFO: `/v3/projects/864f96c99a3b4646b05cb00b09c73da0/users/0dcb7183aaf34ff8aa07cb72905673f7/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:57.448233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617cb98-0899-4a05-bb78-e6c45e674687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=864f96c99a3b4646b05cb00b09c73da0, user_id=0dcb7183aaf34ff8aa07cb72905673f7, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:57.455653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617cb98-0899-4a05-bb78-e6c45e674687 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:57.475466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1142/2291] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:57.479016 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a7d17-33a8-4d08-92c5-f900eca8f51a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:57.480492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a7d17-33a8-4d08-92c5-f900eca8f51a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:57.481018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a7d17-33a8-4d08-92c5-f900eca8f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:57.500698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1150/2292] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:57 2022] PUT /identity/v3/projects/864f96c99a3b4646b05cb00b09c73da0/users/0dcb7183aaf34ff8aa07cb72905673f7/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:57.502290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb09f-82dd-4627-8928-81ee1dee15fa None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:57.502660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb09f-82dd-4627-8928-81ee1dee15fa None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:57.503062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb09f-82dd-4627-8928-81ee1dee15fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:57.531241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-be6a7d17-33a8-4d08-92c5-f900eca8f51a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:57.533447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be6a7d17-33a8-4d08-92c5-f900eca8f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:57.549769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dcfdb09f-82dd-4627-8928-81ee1dee15fa None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:57.552704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dcfdb09f-82dd-4627-8928-81ee1dee15fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:57.598708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:57.719056 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1151/2293] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:57.720208 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdb09f-82dd-4627-8928-81ee1dee15fa None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:57.763055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdb09f-82dd-4627-8928-81ee1dee15fa None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:57.781188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1143/2294] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:57.782935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b4f4f-5d51-4d80-a737-d5663364ed04 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:57.783443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b4f4f-5d51-4d80-a737-d5663364ed04 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:57.786081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b4f4f-5d51-4d80-a737-d5663364ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:57.799972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:57.805508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:57.806905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:57.807539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:57.809744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:57.810372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:57.813543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:57.845344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1152/2295] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:57.845344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:57.848578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:57.873027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5b0b4f4f-5d51-4d80-a737-d5663364ed04 None None] MFA Rules not processed for user `0dcb7183aaf34ff8aa07cb72905673f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:57.876713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5b0b4f4f-5d51-4d80-a737-d5663364ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:58.051684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84db4-27d6-401f-825a-c8deab6a8fb6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.078316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4c018-d61c-45bf-bc00-b62e158e6d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.078316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4c018-d61c-45bf-bc00-b62e158e6d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.078316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4c018-d61c-45bf-bc00-b62e158e6d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.078316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4c018-d61c-45bf-bc00-b62e158e6d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.118495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4c018-d61c-45bf-bc00-b62e158e6d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:58.127126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4c018-d61c-45bf-bc00-b62e158e6d19 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:58.166616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:58.185636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1144/2296] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:58.192022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7666d3-71eb-4e5e-a5d7-c2afa6a66666 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.192022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7666d3-71eb-4e5e-a5d7-c2afa6a66666 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.192022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7666d3-71eb-4e5e-a5d7-c2afa6a66666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.192329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1153/2297] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:58.192408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4c018-d61c-45bf-bc00-b62e158e6d19 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.210413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4c018-d61c-45bf-bc00-b62e158e6d19 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.228042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.228792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.229075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.229350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.230062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:58.232054 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:58.259729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8e7666d3-71eb-4e5e-a5d7-c2afa6a66666 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:58.261790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8e7666d3-71eb-4e5e-a5d7-c2afa6a66666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:58.303041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1154/2298] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:58 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:58.304220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.306599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1145/2299] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:58.307306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7666d3-71eb-4e5e-a5d7-c2afa6a66666 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.322632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:58.352452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7666d3-71eb-4e5e-a5d7-c2afa6a66666 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.539245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45b5e8-bc4a-4669-b7e2-8c22be142bbb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.548466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203382b-1944-4c20-94d8-5937688b8dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.550004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203382b-1944-4c20-94d8-5937688b8dcf service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.550531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203382b-1944-4c20-94d8-5937688b8dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.550949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203382b-1944-4c20-94d8-5937688b8dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.593869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed233ef-7903-4b77-9d88-a65da033af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.594492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed233ef-7903-4b77-9d88-a65da033af03 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.594778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed233ef-7903-4b77-9d88-a65da033af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.595081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed233ef-7903-4b77-9d88-a65da033af03 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.595795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed233ef-7903-4b77-9d88-a65da033af03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:58.598892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed233ef-7903-4b77-9d88-a65da033af03 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:58.649166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1146/2300] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:58 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:58.652039 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed233ef-7903-4b77-9d88-a65da033af03 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.679766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:58.683310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed233ef-7903-4b77-9d88-a65da033af03 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.695241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.695932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.696539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.696820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.698793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:29:58.699159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:58.701466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:58.718063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203382b-1944-4c20-94d8-5937688b8dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:58.719863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203382b-1944-4c20-94d8-5937688b8dcf service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:58.731242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1155/2301] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:58.732183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203382b-1944-4c20-94d8-5937688b8dcf service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.744396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1147/2302] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:29:58.745480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203382b-1944-4c20-94d8-5937688b8dcf service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.748363 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.752997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313e84f-1cc8-4765-8765-6c20aabf3e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.753942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313e84f-1cc8-4765-8765-6c20aabf3e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.754371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313e84f-1cc8-4765-8765-6c20aabf3e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.754869 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313e84f-1cc8-4765-8765-6c20aabf3e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.755857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313e84f-1cc8-4765-8765-6c20aabf3e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:58.758002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313e84f-1cc8-4765-8765-6c20aabf3e57 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:58.777831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1156/2303] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:58.783067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5661f-d75e-452f-babd-b9b80d6b4f49 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.788019 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313e84f-1cc8-4765-8765-6c20aabf3e57 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.806036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27add1fe-3745-4382-9c3b-3465c42c7d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.807086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add1fe-3745-4382-9c3b-3465c42c7d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.807599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add1fe-3745-4382-9c3b-3465c42c7d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.808432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add1fe-3745-4382-9c3b-3465c42c7d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.808631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313e84f-1cc8-4765-8765-6c20aabf3e57 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.810062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27add1fe-3745-4382-9c3b-3465c42c7d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:58.812458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27add1fe-3745-4382-9c3b-3465c42c7d05 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:58.821095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256075e-5b06-4a49-bc3c-91a6626359f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.822064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256075e-5b06-4a49-bc3c-91a6626359f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.822528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256075e-5b06-4a49-bc3c-91a6626359f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.823666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256075e-5b06-4a49-bc3c-91a6626359f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.824841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256075e-5b06-4a49-bc3c-91a6626359f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:58.827440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256075e-5b06-4a49-bc3c-91a6626359f8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:58.843563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1157/2304] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:58.847522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256075e-5b06-4a49-bc3c-91a6626359f8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.866733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256075e-5b06-4a49-bc3c-91a6626359f8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.870590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1148/2305] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:29:58 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:29:58.872601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27add1fe-3745-4382-9c3b-3465c42c7d05 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:58.971337 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.972268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.973203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:58.973801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] PATH_INFO: `/v3/projects/ade99499594b43e09935c9346af2845f/users/bb9dd20a22d8434391ca24b2d6ddcdfc/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:58.990095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27add1fe-3745-4382-9c3b-3465c42c7d05 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:58.998134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514f3a-2c43-4ef2-8de4-1fcf0efe99fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:58.998833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514f3a-2c43-4ef2-8de4-1fcf0efe99fb admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:58.999248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514f3a-2c43-4ef2-8de4-1fcf0efe99fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.007359 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514f3a-2c43-4ef2-8de4-1fcf0efe99fb admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:59.008144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade99499594b43e09935c9346af2845f, user_id=bb9dd20a22d8434391ca24b2d6ddcdfc, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:59.008259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18514f3a-2c43-4ef2-8de4-1fcf0efe99fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:59.010750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18514f3a-2c43-4ef2-8de4-1fcf0efe99fb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:59.011999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:59.036871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1158/2306] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:58 2022] PUT /identity/v3/projects/ade99499594b43e09935c9346af2845f/users/bb9dd20a22d8434391ca24b2d6ddcdfc/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:29:59.037054 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1149/2307] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:29:58 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:29:59.037908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514f3a-2c43-4ef2-8de4-1fcf0efe99fb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:59.038110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:59.047738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:59.106129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:59.128134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514f3a-2c43-4ef2-8de4-1fcf0efe99fb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:59.132924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e8b30-c281-4216-9c2e-ce65c69aa8d8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:59.139630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:59.140460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:59.140868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.141214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] PATH_INFO: `/v3/projects/a71c9cbae3f1476c93ce86691432f94f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:59.142514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71c9cbae3f1476c93ce86691432f94f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:59.144617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:59.212395 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:59.218888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71c9cbae3f1476c93ce86691432f94f', 'request_id': 'req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:59.238455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71c9cbae3f1476c93ce86691432f94f', 'request_id': 'req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:59.247846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71c9cbae3f1476c93ce86691432f94f', 'request_id': 'req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:59.257657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:59.258882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:59.259198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.259476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:59.267101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:59.286287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] The token cache is being invalidate because project a71c9cbae3f1476c93ce86691432f94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:29:59.287742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:59.290149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d1458d49-9b87-4f97-8a27-6c2e3a87bdfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:29:59.296035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1159/2308] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:29:59 2022] DELETE /identity/v3/projects/a71c9cbae3f1476c93ce86691432f94f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:59.297874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375c46-e9de-4a06-b596-3c4208de3ad8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:59.298053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375c46-e9de-4a06-b596-3c4208de3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.298283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375c46-e9de-4a06-b596-3c4208de3ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:59.393674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:59.394884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f6375c46-e9de-4a06-b596-3c4208de3ad8 None None] MFA Rules not processed for user `bb9dd20a22d8434391ca24b2d6ddcdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:59.395193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:59.396172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f6375c46-e9de-4a06-b596-3c4208de3ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:59.408289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1150/2309] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:29:59.409296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:59.427505 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538785e-ff41-4f21-ace7-6260fb91178d service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:59.502819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:59.504300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:59.504687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.505214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:59.506680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:59.509063 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:59.524307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1151/2310] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:29:59.528719 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:59.533335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:59.548022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b6dc-cd50-4900-ad53-463b4821ef83 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:59.555339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583038-ab1c-41f6-ad26-1bed98deea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:59.556197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583038-ab1c-41f6-ad26-1bed98deea26 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:59.556508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583038-ab1c-41f6-ad26-1bed98deea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.556987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583038-ab1c-41f6-ad26-1bed98deea26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:59.557968 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c583038-ab1c-41f6-ad26-1bed98deea26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:59.559976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c583038-ab1c-41f6-ad26-1bed98deea26 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:59.577484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1152/2311] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:29:59.578564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583038-ab1c-41f6-ad26-1bed98deea26 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:59.590302 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583038-ab1c-41f6-ad26-1bed98deea26 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:59.597464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7015a02-373f-43c7-b52e-c95b9e8d4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:59.598674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015a02-373f-43c7-b52e-c95b9e8d4c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:59.599076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015a02-373f-43c7-b52e-c95b9e8d4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.601846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7015a02-373f-43c7-b52e-c95b9e8d4c20 admin admin] PATH_INFO: `/v3/projects/b5916101c99c40c2be23aa39b63ab8c0/users/de182a1a923f456d9ea1bbb8538c42e5/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:59.607017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1160/2312] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:29:59.626892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375c46-e9de-4a06-b596-3c4208de3ad8 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:29:59.629622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f6375c46-e9de-4a06-b596-3c4208de3ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:59.637568 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7015a02-373f-43c7-b52e-c95b9e8d4c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5916101c99c40c2be23aa39b63ab8c0, user_id=de182a1a923f456d9ea1bbb8538c42e5, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:29:59.645893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7015a02-373f-43c7-b52e-c95b9e8d4c20 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:29:59.695479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1153/2313] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:29:59 2022] PUT /identity/v3/projects/b5916101c99c40c2be23aa39b63ab8c0/users/de182a1a923f456d9ea1bbb8538c42e5/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:29:59.702613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924df62c-eaa5-42d7-9dde-e9580f10dfa8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:59.703099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924df62c-eaa5-42d7-9dde-e9580f10dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.703573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924df62c-eaa5-42d7-9dde-e9580f10dfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:29:59.730646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:59.752536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375c46-e9de-4a06-b596-3c4208de3ad8 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:29:59.773976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-924df62c-eaa5-42d7-9dde-e9580f10dfa8 None None] MFA Rules not processed for user `de182a1a923f456d9ea1bbb8538c42e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:29:59.777463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-924df62c-eaa5-42d7-9dde-e9580f10dfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:29:59.915032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:29:59.915715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:29:59.916721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:29:59.917001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:00.003683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1154/2314] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:00.021044 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924df62c-eaa5-42d7-9dde-e9580f10dfa8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:00.070776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:00.159123 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:00.161182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:00.185727 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1161/2315] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:00.187117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:00.189338 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:00.220856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924df62c-eaa5-42d7-9dde-e9580f10dfa8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:00.231360 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07d344-3cf7-46cc-be33-9a5113be0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:00.237295 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07d344-3cf7-46cc-be33-9a5113be0430 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:00.241720 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07d344-3cf7-46cc-be33-9a5113be0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:00.242121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07d344-3cf7-46cc-be33-9a5113be0430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:00.242998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07d344-3cf7-46cc-be33-9a5113be0430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:00.247396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07d344-3cf7-46cc-be33-9a5113be0430 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:00.338835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1155/2316] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:00 2022] POST /identity/v3/projects => generated 385 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:00.340349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07d344-3cf7-46cc-be33-9a5113be0430 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:00.426140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e4894-e649-4fb0-b923-8041ec409be9 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:00.507089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07d344-3cf7-46cc-be33-9a5113be0430 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:00.513988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce207de-8de2-412e-bd3a-44ef5cd7c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:00.516431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce207de-8de2-412e-bd3a-44ef5cd7c03f admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:00.517559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce207de-8de2-412e-bd3a-44ef5cd7c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:00.518126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce207de-8de2-412e-bd3a-44ef5cd7c03f admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:00.520444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce207de-8de2-412e-bd3a-44ef5cd7c03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:00.524390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce207de-8de2-412e-bd3a-44ef5cd7c03f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:00.570062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1156/2317] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:00 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:00.579067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce207de-8de2-412e-bd3a-44ef5cd7c03f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:00.581283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:00.584360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:00.584360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:00.584574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] PATH_INFO: `/v3/users/4695141c1dab4bb9b1decabac112f4dd` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:00.593007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4695141c1dab4bb9b1decabac112f4dd)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:00.597779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:00.608792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce207de-8de2-412e-bd3a-44ef5cd7c03f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:00.632942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0a266-c800-4acb-b696-6fa3a16f97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:00.637001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0a266-c800-4acb-b696-6fa3a16f97dd admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:00.637351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0a266-c800-4acb-b696-6fa3a16f97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:00.640027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0a266-c800-4acb-b696-6fa3a16f97dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:00.645177 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0a266-c800-4acb-b696-6fa3a16f97dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:00.647070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0a266-c800-4acb-b696-6fa3a16f97dd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:00.657013 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:00.669044 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1157/2318] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:00.673365 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0a266-c800-4acb-b696-6fa3a16f97dd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:00.724329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4695141c1dab4bb9b1decabac112f4dd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:00.735178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0a266-c800-4acb-b696-6fa3a16f97dd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:00.741028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4695141c1dab4bb9b1decabac112f4dd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:00.741807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4695141c1dab4bb9b1decabac112f4dd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:00.742437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4695141c1dab4bb9b1decabac112f4dd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:00.751857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-187561ea-7aa4-40a8-9a9a-85785dcd9e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4695141c1dab4bb9b1decabac112f4dd'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:00.753435 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:00.755193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:00.755585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:00.755971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] PATH_INFO: `/v3/projects/f990ad9d8af54fc2a6a8b24665fe0cca/users/5feeb1c7925d4d7b8e7c9d0d2c80d8c4/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:00.765200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:00.776620 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1162/2319] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:00 2022] DELETE /identity/v3/users/4695141c1dab4bb9b1decabac112f4dd => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:00.779978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0817-a2c5-4a43-8e27-5de17d8c2643 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:00.780564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0817-a2c5-4a43-8e27-5de17d8c2643 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:00.781635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0817-a2c5-4a43-8e27-5de17d8c2643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:00.798277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f990ad9d8af54fc2a6a8b24665fe0cca, user_id=5feeb1c7925d4d7b8e7c9d0d2c80d8c4, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:00.802624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:00.810675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-dd3e0817-a2c5-4a43-8e27-5de17d8c2643 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:00.811814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-dd3e0817-a2c5-4a43-8e27-5de17d8c2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:00.842191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1158/2320] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:00 2022] PUT /identity/v3/projects/f990ad9d8af54fc2a6a8b24665fe0cca/users/5feeb1c7925d4d7b8e7c9d0d2c80d8c4/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:00.847611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:00.857867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:00.990268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1163/2321] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:00.991771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef708eb-9155-48b9-9835-54d8b86340fc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:00.997384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:00.998088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:00.998373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:00.998649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:00.999541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:01.001248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:01.014651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1159/2322] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:01.018558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e0817-a2c5-4a43-8e27-5de17d8c2643 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:01.031594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e0817-a2c5-4a43-8e27-5de17d8c2643 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:01.037173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3faf0-b3b6-487d-b468-523f75ea1fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:01.038090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3faf0-b3b6-487d-b468-523f75ea1fce admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:01.038383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3faf0-b3b6-487d-b468-523f75ea1fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:01.038645 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3faf0-b3b6-487d-b468-523f75ea1fce admin admin] PATH_INFO: `/v3/projects/f990ad9d8af54fc2a6a8b24665fe0cca/users/5feeb1c7925d4d7b8e7c9d0d2c80d8c4/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:01.040885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3faf0-b3b6-487d-b468-523f75ea1fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f990ad9d8af54fc2a6a8b24665fe0cca, user_id=5feeb1c7925d4d7b8e7c9d0d2c80d8c4, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:01.043999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3faf0-b3b6-487d-b468-523f75ea1fce admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:01.057412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:01.058599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1164/2323] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:01 2022] PUT /identity/v3/projects/f990ad9d8af54fc2a6a8b24665fe0cca/users/5feeb1c7925d4d7b8e7c9d0d2c80d8c4/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:01.060391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:01.070776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9620472-b133-4ab7-9c3d-4ae426bc37e4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:01.071172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9620472-b133-4ab7-9c3d-4ae426bc37e4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:01.071454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9620472-b133-4ab7-9c3d-4ae426bc37e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:01.125305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e9620472-b133-4ab7-9c3d-4ae426bc37e4 None None] MFA Rules not processed for user `5feeb1c7925d4d7b8e7c9d0d2c80d8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:01.126560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e9620472-b133-4ab7-9c3d-4ae426bc37e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:01.198174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e847ba-a5fc-4829-876b-490ca9da36c9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:01.265788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:01.266796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:01.267213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:01.267636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:01.286590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1165/2324] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:01.291377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9620472-b133-4ab7-9c3d-4ae426bc37e4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:01.306071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e9620472-b133-4ab7-9c3d-4ae426bc37e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:01.361261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:01.416721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9620472-b133-4ab7-9c3d-4ae426bc37e4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:01.423246 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:01.425415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:01.429764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:01.430595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:01.430885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:01.432726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:01.439267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1160/2325] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:01.439905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:01.476165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:01.522629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:01.525753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:01.538585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1166/2326] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:02.267928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:02.271264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:02.297923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46378-8bd4-4b83-bbec-9db6c8fa6702 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:02.308437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:02.309603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:02.309958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:02.310482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] PATH_INFO: `/v3/projects/e7998889112748bb98c6f514404dbaae` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:02.311828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7998889112748bb98c6f514404dbaae)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:02.314307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:02.451879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7998889112748bb98c6f514404dbaae', 'request_id': 'req-a168b728-85bf-488b-a7ba-9e3ec3242cac'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.463724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7998889112748bb98c6f514404dbaae', 'request_id': 'req-a168b728-85bf-488b-a7ba-9e3ec3242cac'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.483185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7998889112748bb98c6f514404dbaae', 'request_id': 'req-a168b728-85bf-488b-a7ba-9e3ec3242cac'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.525530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] The token cache is being invalidate because project e7998889112748bb98c6f514404dbaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:02.525530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.538563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.545464 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1161/2327] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:02 2022] DELETE /identity/v3/projects/e7998889112748bb98c6f514404dbaae => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:02.549588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:02.580086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994f19b-46b7-4cab-bdef-6355e2012fd8 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:02.677052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:02.678001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:02.678286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:02.678561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] PATH_INFO: `/v3/users/0dcb7183aaf34ff8aa07cb72905673f7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:02.680214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcb7183aaf34ff8aa07cb72905673f7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:02.682450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:02.786843 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcb7183aaf34ff8aa07cb72905673f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.824726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcb7183aaf34ff8aa07cb72905673f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.826946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcb7183aaf34ff8aa07cb72905673f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.828166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcb7183aaf34ff8aa07cb72905673f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.894936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c76c50dd-3c66-4139-b943-0836f7db4438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcb7183aaf34ff8aa07cb72905673f7'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:02.936543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1167/2328] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:02 2022] DELETE /identity/v3/users/0dcb7183aaf34ff8aa07cb72905673f7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:03.712776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:03.715661 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:03.741984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b728-85bf-488b-a7ba-9e3ec3242cac admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:03.872939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:03.873895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:03.875232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:03.875534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] PATH_INFO: `/v3/projects/864f96c99a3b4646b05cb00b09c73da0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:03.877467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864f96c99a3b4646b05cb00b09c73da0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:03.880924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:03.966322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864f96c99a3b4646b05cb00b09c73da0', 'request_id': 'req-06906191-707f-4ebb-b7d7-abcb94d5bb96'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:03.978848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864f96c99a3b4646b05cb00b09c73da0', 'request_id': 'req-06906191-707f-4ebb-b7d7-abcb94d5bb96'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:03.987580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864f96c99a3b4646b05cb00b09c73da0', 'request_id': 'req-06906191-707f-4ebb-b7d7-abcb94d5bb96'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:03.989566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:04.014603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] The token cache is being invalidate because project 864f96c99a3b4646b05cb00b09c73da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:04.016933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:04.017775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-06906191-707f-4ebb-b7d7-abcb94d5bb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:04.020192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1162/2329] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:03 2022] DELETE /identity/v3/projects/864f96c99a3b4646b05cb00b09c73da0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:04.025845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9149d-da14-46df-8375-86cb445f13be None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.026526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9149d-da14-46df-8375-86cb445f13be None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.026526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9149d-da14-46df-8375-86cb445f13be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.068663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e5e9149d-da14-46df-8375-86cb445f13be None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:04.069988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e5e9149d-da14-46df-8375-86cb445f13be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:04.168747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:04.203046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1168/2330] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:04.211776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6efb2f-f852-484d-a69a-f60c9197e985 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.212061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6efb2f-f852-484d-a69a-f60c9197e985 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.212340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6efb2f-f852-484d-a69a-f60c9197e985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.236352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2c6efb2f-f852-484d-a69a-f60c9197e985 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:04.237951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2c6efb2f-f852-484d-a69a-f60c9197e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:04.250557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1163/2331] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:04.255418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9149d-da14-46df-8375-86cb445f13be None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:04.266128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9149d-da14-46df-8375-86cb445f13be None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:04.273859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:04.274548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.274880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.275185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.275978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:04.276289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:04.278745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:04.297981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1169/2332] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:04.299524 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6efb2f-f852-484d-a69a-f60c9197e985 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:04.310479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6efb2f-f852-484d-a69a-f60c9197e985 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:04.315449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0b10b-e606-49f6-ad83-e7ea1171ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:04.316077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0b10b-e606-49f6-ad83-e7ea1171ccd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.316356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0b10b-e606-49f6-ad83-e7ea1171ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.316663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0b10b-e606-49f6-ad83-e7ea1171ccd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.317335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0b10b-e606-49f6-ad83-e7ea1171ccd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:04.319317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0b10b-e606-49f6-ad83-e7ea1171ccd6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:04.350220 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1164/2333] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:04 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:04.351316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:04.366906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669c3e-5e85-4a18-ba20-dd571605ffee admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:04.427407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35821f6f-192b-4552-b68f-032fb29216a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:04.428100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35821f6f-192b-4552-b68f-032fb29216a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.428391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35821f6f-192b-4552-b68f-032fb29216a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.428676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35821f6f-192b-4552-b68f-032fb29216a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.429554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35821f6f-192b-4552-b68f-032fb29216a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:04.432065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35821f6f-192b-4552-b68f-032fb29216a8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:04.454055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1170/2334] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:04 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:30:04.458273 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0b10b-e606-49f6-ad83-e7ea1171ccd6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:04.473150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0b10b-e606-49f6-ad83-e7ea1171ccd6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:04.480145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f05f6-13c5-4007-801f-5f67edb3b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:04.482542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f05f6-13c5-4007-801f-5f67edb3b952 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.482921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f05f6-13c5-4007-801f-5f67edb3b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.483320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f05f6-13c5-4007-801f-5f67edb3b952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.484139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f05f6-13c5-4007-801f-5f67edb3b952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:04.486002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f05f6-13c5-4007-801f-5f67edb3b952 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:04.498767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1165/2335] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:04.503122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35821f6f-192b-4552-b68f-032fb29216a8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:04.516646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35821f6f-192b-4552-b68f-032fb29216a8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:04.522768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88411f6a-673d-4c7c-b99e-b305507364ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:04.523138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88411f6a-673d-4c7c-b99e-b305507364ad admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.523423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88411f6a-673d-4c7c-b99e-b305507364ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.523695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88411f6a-673d-4c7c-b99e-b305507364ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.525178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88411f6a-673d-4c7c-b99e-b305507364ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:04.528300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88411f6a-673d-4c7c-b99e-b305507364ad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:04.541487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1171/2336] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:04.545790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f05f6-13c5-4007-801f-5f67edb3b952 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:04.556181 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f05f6-13c5-4007-801f-5f67edb3b952 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:04.562538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:04.563489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.563767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.564045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] PATH_INFO: `/v3/projects/16858bc753c44b16bd8a3aa7095fa148/users/ea9f571b8880418191759874fe71dfaa/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.580976 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16858bc753c44b16bd8a3aa7095fa148, user_id=ea9f571b8880418191759874fe71dfaa, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:04.583718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:04.596619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1166/2337] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:04 2022] PUT /identity/v3/projects/16858bc753c44b16bd8a3aa7095fa148/users/ea9f571b8880418191759874fe71dfaa/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:04.609903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3aaa-7c5d-4741-87e8-6b51324f8988 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.610289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3aaa-7c5d-4741-87e8-6b51324f8988 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.610572 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3aaa-7c5d-4741-87e8-6b51324f8988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.640453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-366c3aaa-7c5d-4741-87e8-6b51324f8988 None None] MFA Rules not processed for user `ea9f571b8880418191759874fe71dfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:04.641698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-366c3aaa-7c5d-4741-87e8-6b51324f8988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:04.713036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1172/2338] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:04.724866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:04.727016 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:04.804876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878de08-65ac-488b-b6a4-c3636283dc02 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:04.809921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92542-d19c-4cf8-b944-44f66e226a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:04.810665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92542-d19c-4cf8-b944-44f66e226a6f service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:04.810995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92542-d19c-4cf8-b944-44f66e226a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:04.811503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b92542-d19c-4cf8-b944-44f66e226a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:04.829709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b92542-d19c-4cf8-b944-44f66e226a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:04.831640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b92542-d19c-4cf8-b944-44f66e226a6f service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:04.849448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1167/2339] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:07.271444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3aaa-7c5d-4741-87e8-6b51324f8988 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:07.272834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-366c3aaa-7c5d-4741-87e8-6b51324f8988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:07.288367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3aaa-7c5d-4741-87e8-6b51324f8988 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:07.292643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072a07-b65b-4651-a413-d80b7f0736ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:07.293299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072a07-b65b-4651-a413-d80b7f0736ae service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:07.293625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072a07-b65b-4651-a413-d80b7f0736ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:07.293950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072a07-b65b-4651-a413-d80b7f0736ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:07.296100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b072a07-b65b-4651-a413-d80b7f0736ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:07.364884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:07.395086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072a07-b65b-4651-a413-d80b7f0736ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:07.397112 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072a07-b65b-4651-a413-d80b7f0736ae service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:07.412775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1173/2340] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:11.874907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92542-d19c-4cf8-b944-44f66e226a6f service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:11.989018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b92542-d19c-4cf8-b944-44f66e226a6f service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:11.994375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:11.995827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:11.996298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:11.996920 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] PATH_INFO: `/v3/users/ea9f571b8880418191759874fe71dfaa` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:11.998213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9f571b8880418191759874fe71dfaa)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:12.000579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:12.047815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:12.063596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9f571b8880418191759874fe71dfaa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.079776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9f571b8880418191759874fe71dfaa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.080526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9f571b8880418191759874fe71dfaa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.088143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9f571b8880418191759874fe71dfaa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.089116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9f571b8880418191759874fe71dfaa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.109305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1168/2341] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:11 2022] DELETE /identity/v3/users/ea9f571b8880418191759874fe71dfaa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:12.113846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0bb77-8d59-437e-9eda-00fcff792bb3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:12.114383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0bb77-8d59-437e-9eda-00fcff792bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:12.114383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0bb77-8d59-437e-9eda-00fcff792bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:12.137015 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-f8d0bb77-8d59-437e-9eda-00fcff792bb3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:12.138416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f8d0bb77-8d59-437e-9eda-00fcff792bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:12.231129 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1174/2342] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:12.244557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:12.247654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:12.352196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0ef4-c65f-43df-ad16-e112148bb109 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:12.356830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:12.357660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:12.358088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:12.358503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:12.369968 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:12.372082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:12.386528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1169/2343] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:12.712540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0bb77-8d59-437e-9eda-00fcff792bb3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:12.714703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f8d0bb77-8d59-437e-9eda-00fcff792bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:12.723061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:12.724575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:12.727536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0bb77-8d59-437e-9eda-00fcff792bb3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:12.732894 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:12.734131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:12.734495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:12.734846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] PATH_INFO: `/v3/users/de182a1a923f456d9ea1bbb8538c42e5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:12.736525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de182a1a923f456d9ea1bbb8538c42e5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:12.741310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:12.759584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d34fae-29b7-4661-95fe-fdee311d50c8 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:12.781535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:12.782439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:12.782721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:12.783024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] PATH_INFO: `/v3/projects/16858bc753c44b16bd8a3aa7095fa148` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:12.784727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16858bc753c44b16bd8a3aa7095fa148)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:12.786838 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:12.847163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de182a1a923f456d9ea1bbb8538c42e5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.850804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16858bc753c44b16bd8a3aa7095fa148', 'request_id': 'req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.861205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de182a1a923f456d9ea1bbb8538c42e5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.861997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de182a1a923f456d9ea1bbb8538c42e5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.862773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de182a1a923f456d9ea1bbb8538c42e5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.863093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16858bc753c44b16bd8a3aa7095fa148', 'request_id': 'req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.871954 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16858bc753c44b16bd8a3aa7095fa148', 'request_id': 'req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.872364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3f1e01ad-c703-48f6-a9b6-c808d7b05900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de182a1a923f456d9ea1bbb8538c42e5'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.888407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1175/2344] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:12 2022] DELETE /identity/v3/users/de182a1a923f456d9ea1bbb8538c42e5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:12.892455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] The token cache is being invalidate because project 16858bc753c44b16bd8a3aa7095fa148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:12.893168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.893736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aac0dc94-76e2-4e8e-8b9f-4bdb824210a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:12.894131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a20fdb-a214-44c2-a0db-81cab86217c3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:12.894484 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a20fdb-a214-44c2-a0db-81cab86217c3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:12.894873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a20fdb-a214-44c2-a0db-81cab86217c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:12.895792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1170/2345] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:12 2022] DELETE /identity/v3/projects/16858bc753c44b16bd8a3aa7095fa148 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:12.900713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65c62-f6f9-4463-9508-b17dd188d0ea None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:12.900713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65c62-f6f9-4463-9508-b17dd188d0ea None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:12.901215 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65c62-f6f9-4463-9508-b17dd188d0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:12.915290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-87a20fdb-a214-44c2-a0db-81cab86217c3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:12.916685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-87a20fdb-a214-44c2-a0db-81cab86217c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:12.930581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-89e65c62-f6f9-4463-9508-b17dd188d0ea None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:12.932229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-89e65c62-f6f9-4463-9508-b17dd188d0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:12.978551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:12.980931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:13.001176 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1176/2346] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:13.002194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a20fdb-a214-44c2-a0db-81cab86217c3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.003917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-87a20fdb-a214-44c2-a0db-81cab86217c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.016587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a20fdb-a214-44c2-a0db-81cab86217c3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.020313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1171/2347] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:13.021244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e65c62-f6f9-4463-9508-b17dd188d0ea None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.022550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-89e65c62-f6f9-4463-9508-b17dd188d0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.024837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.026473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.027229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.027516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] PATH_INFO: `/v3/users/7da4dc649939494e999a1c1800f135b4` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.028826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da4dc649939494e999a1c1800f135b4)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.030884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.088335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da4dc649939494e999a1c1800f135b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.103334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e65c62-f6f9-4463-9508-b17dd188d0ea None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.106120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da4dc649939494e999a1c1800f135b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.106940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da4dc649939494e999a1c1800f135b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.107743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da4dc649939494e999a1c1800f135b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.108367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21819-0b66-410b-aa98-0d7c1886f602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.109014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21819-0b66-410b-aa98-0d7c1886f602 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.109461 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21819-0b66-410b-aa98-0d7c1886f602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.109799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21819-0b66-410b-aa98-0d7c1886f602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.111963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6db21819-0b66-410b-aa98-0d7c1886f602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.115841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-60e9bf70-e028-4301-a5fe-26db9db4d696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da4dc649939494e999a1c1800f135b4'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.132929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21819-0b66-410b-aa98-0d7c1886f602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.133135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1177/2348] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:13 2022] DELETE /identity/v3/users/7da4dc649939494e999a1c1800f135b4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:13.134383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21819-0b66-410b-aa98-0d7c1886f602 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.134555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8341-cd03-44a6-af33-5b9c972e31e7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.134802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8341-cd03-44a6-af33-5b9c972e31e7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.135114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8341-cd03-44a6-af33-5b9c972e31e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.144856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1172/2349] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:13.146397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7b891-09b8-486e-be2d-b5cc7846f985 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.146692 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7b891-09b8-486e-be2d-b5cc7846f985 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.147001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7b891-09b8-486e-be2d-b5cc7846f985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.159985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8a0a8341-cd03-44a6-af33-5b9c972e31e7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:13.161327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a0a8341-cd03-44a6-af33-5b9c972e31e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.167923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f5b7b891-09b8-486e-be2d-b5cc7846f985 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:13.169196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f5b7b891-09b8-486e-be2d-b5cc7846f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.243810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1178/2350] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:13.248968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8341-cd03-44a6-af33-5b9c972e31e7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.259711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1173/2351] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:13.264287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8341-cd03-44a6-af33-5b9c972e31e7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.270849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.271569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.271852 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.272126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.273262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:13.273512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.274635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7b891-09b8-486e-be2d-b5cc7846f985 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.275246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.277851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f5b7b891-09b8-486e-be2d-b5cc7846f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.288451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1179/2352] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:30:13.292882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.311513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7842e4e-3450-4b89-b517-2f5980c8a217 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.319207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906687-6296-4280-a4f8-e0b472b26fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.319941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906687-6296-4280-a4f8-e0b472b26fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.322459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906687-6296-4280-a4f8-e0b472b26fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.322756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906687-6296-4280-a4f8-e0b472b26fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.323503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b906687-6296-4280-a4f8-e0b472b26fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.328483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b906687-6296-4280-a4f8-e0b472b26fa3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.377966 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1180/2353] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:13 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:13.378164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7b891-09b8-486e-be2d-b5cc7846f985 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.380118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906687-6296-4280-a4f8-e0b472b26fa3 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.415218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:13.438560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.439501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.439788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.440068 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.446098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:13.534059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906687-6296-4280-a4f8-e0b472b26fa3 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.546412 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed7c6a-82bd-4bf6-afc3-6c24a31c4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.547143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed7c6a-82bd-4bf6-afc3-6c24a31c4d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.547427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed7c6a-82bd-4bf6-afc3-6c24a31c4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.547789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed7c6a-82bd-4bf6-afc3-6c24a31c4d94 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.548492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed7c6a-82bd-4bf6-afc3-6c24a31c4d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.550629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed7c6a-82bd-4bf6-afc3-6c24a31c4d94 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.563143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.566526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.577355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1174/2354] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:13.578120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.579489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.595106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1181/2355] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:13 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:13.598436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff006e-6219-49f9-a755-6c73380562b5 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.600402 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed7c6a-82bd-4bf6-afc3-6c24a31c4d94 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.605756 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.606835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.607154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.607473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] PATH_INFO: `/v3/projects/b5916101c99c40c2be23aa39b63ab8c0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.609138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5916101c99c40c2be23aa39b63ab8c0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.611488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.616325 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed7c6a-82bd-4bf6-afc3-6c24a31c4d94 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.627147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9087b-ff67-4a34-95b6-fe08e0d7b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.628452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9087b-ff67-4a34-95b6-fe08e0d7b756 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.628919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9087b-ff67-4a34-95b6-fe08e0d7b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.629371 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9087b-ff67-4a34-95b6-fe08e0d7b756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.630393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9087b-ff67-4a34-95b6-fe08e0d7b756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.633445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9087b-ff67-4a34-95b6-fe08e0d7b756 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.653426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1182/2356] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:13.654623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9087b-ff67-4a34-95b6-fe08e0d7b756 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.667837 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9087b-ff67-4a34-95b6-fe08e0d7b756 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.696368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5916101c99c40c2be23aa39b63ab8c0', 'request_id': 'req-a085edf6-5e68-4471-8876-6cff7d99e797'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.721034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5916101c99c40c2be23aa39b63ab8c0', 'request_id': 'req-a085edf6-5e68-4471-8876-6cff7d99e797'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.729185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5916101c99c40c2be23aa39b63ab8c0', 'request_id': 'req-a085edf6-5e68-4471-8876-6cff7d99e797'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.750496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] The token cache is being invalidate because project b5916101c99c40c2be23aa39b63ab8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:13.750787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.751824 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:13.754535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1175/2357] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:13 2022] DELETE /identity/v3/projects/b5916101c99c40c2be23aa39b63ab8c0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:13.761055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.764173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.776764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.777827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.778103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.778435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.779289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.781280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.797549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1183/2358] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:13.798759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:13.800569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.826889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd4eb6-a9c9-4524-910f-d4b257f3eeab admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.834828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679ec79-09f4-4c13-8ffd-2658945e8c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.835962 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679ec79-09f4-4c13-8ffd-2658945e8c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.836327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679ec79-09f4-4c13-8ffd-2658945e8c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.837646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679ec79-09f4-4c13-8ffd-2658945e8c16 admin admin] PATH_INFO: `/v3/projects/4cf29c9acc7347b88ba0b790cb487298/users/73f55d93f3ac400aa4ba68d7d50a14de/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.858999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679ec79-09f4-4c13-8ffd-2658945e8c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf29c9acc7347b88ba0b790cb487298, user_id=73f55d93f3ac400aa4ba68d7d50a14de, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.862627 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679ec79-09f4-4c13-8ffd-2658945e8c16 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.873069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085edf6-5e68-4471-8876-6cff7d99e797 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:13.883205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:13.884703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.885184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.885564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] PATH_INFO: `/v3/users/5feeb1c7925d4d7b8e7c9d0d2c80d8c4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.887103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5feeb1c7925d4d7b8e7c9d0d2c80d8c4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:13.889311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:13.902818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:13.912561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1184/2359] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:13 2022] PUT /identity/v3/projects/4cf29c9acc7347b88ba0b790cb487298/users/73f55d93f3ac400aa4ba68d7d50a14de/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:13.929479 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810358c-4be2-4c72-aa6c-b9ce73cc6477 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:13.930061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810358c-4be2-4c72-aa6c-b9ce73cc6477 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:13.930413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810358c-4be2-4c72-aa6c-b9ce73cc6477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:13.979160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a810358c-4be2-4c72-aa6c-b9ce73cc6477 None None] MFA Rules not processed for user `73f55d93f3ac400aa4ba68d7d50a14de`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:13.980955 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a810358c-4be2-4c72-aa6c-b9ce73cc6477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:13.990323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5feeb1c7925d4d7b8e7c9d0d2c80d8c4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.016356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5feeb1c7925d4d7b8e7c9d0d2c80d8c4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.017749 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5feeb1c7925d4d7b8e7c9d0d2c80d8c4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.043909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5feeb1c7925d4d7b8e7c9d0d2c80d8c4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.047024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5feeb1c7925d4d7b8e7c9d0d2c80d8c4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.074036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1176/2360] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:13 2022] DELETE /identity/v3/users/5feeb1c7925d4d7b8e7c9d0d2c80d8c4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:14.150911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:14.153628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.157183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1185/2361] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:14.163472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810358c-4be2-4c72-aa6c-b9ce73cc6477 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:14.168992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a810358c-4be2-4c72-aa6c-b9ce73cc6477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.215222 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:14.306236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b3cf-d2b9-42c3-833d-d479b7d0d51a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:14.311846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:14.313569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.313569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.313569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] PATH_INFO: `/v3/projects/05de61a6fa4a47839a96f6c35b60f58b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.314935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05de61a6fa4a47839a96f6c35b60f58b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:14.318190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:14.322712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810358c-4be2-4c72-aa6c-b9ce73cc6477 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:14.328840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb530-9398-4519-a47d-f3aaee11d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:14.330009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb530-9398-4519-a47d-f3aaee11d8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.330434 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb530-9398-4519-a47d-f3aaee11d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.331151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cb530-9398-4519-a47d-f3aaee11d8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.331880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cb530-9398-4519-a47d-f3aaee11d8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:14.334286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cb530-9398-4519-a47d-f3aaee11d8ca admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:14.374942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1186/2362] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:14 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:14.379551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb530-9398-4519-a47d-f3aaee11d8ca admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:14.408708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05de61a6fa4a47839a96f6c35b60f58b', 'request_id': 'req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.424281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05de61a6fa4a47839a96f6c35b60f58b', 'request_id': 'req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.435582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05de61a6fa4a47839a96f6c35b60f58b', 'request_id': 'req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.455007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] The token cache is being invalidate because project 05de61a6fa4a47839a96f6c35b60f58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:14.455242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.455961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-62ae7eba-1da3-4e7c-bc16-6dcf74c4e48f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.458531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1177/2363] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:14 2022] DELETE /identity/v3/projects/05de61a6fa4a47839a96f6c35b60f58b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:14.464564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e9b3-b130-4a6b-95e5-fb069a01fe62 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.464857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e9b3-b130-4a6b-95e5-fb069a01fe62 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.465101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e9b3-b130-4a6b-95e5-fb069a01fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.476490 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cb530-9398-4519-a47d-f3aaee11d8ca admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:14.490497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d013e9b3-b130-4a6b-95e5-fb069a01fe62 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:14.491859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d013e9b3-b130-4a6b-95e5-fb069a01fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.512744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:14.580286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79f6f7-e6b8-4f64-8677-3ed430353fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:14.581246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79f6f7-e6b8-4f64-8677-3ed430353fed admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.581604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79f6f7-e6b8-4f64-8677-3ed430353fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.581790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79f6f7-e6b8-4f64-8677-3ed430353fed admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.582736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79f6f7-e6b8-4f64-8677-3ed430353fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:14.585289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79f6f7-e6b8-4f64-8677-3ed430353fed admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:14.622731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1178/2364] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:14.622731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013e9b3-b130-4a6b-95e5-fb069a01fe62 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:14.622731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d013e9b3-b130-4a6b-95e5-fb069a01fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.635227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1187/2365] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:14 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:14.639283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4bd70-03fb-4894-bd35-1538197cf9c7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.639624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4bd70-03fb-4894-bd35-1538197cf9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.639872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4bd70-03fb-4894-bd35-1538197cf9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.640491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013e9b3-b130-4a6b-95e5-fb069a01fe62 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:14.645940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:14.647309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.647926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.648492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] PATH_INFO: `/v3/projects/f990ad9d8af54fc2a6a8b24665fe0cca` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.650603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f990ad9d8af54fc2a6a8b24665fe0cca)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:14.653927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:14.673575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-64e4bd70-03fb-4894-bd35-1538197cf9c7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:14.675929 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64e4bd70-03fb-4894-bd35-1538197cf9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.685217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1188/2366] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:14.689330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4bd70-03fb-4894-bd35-1538197cf9c7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:14.690738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-64e4bd70-03fb-4894-bd35-1538197cf9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.704999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4bd70-03fb-4894-bd35-1538197cf9c7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:14.712895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8650d-d4f6-423d-a6b2-23e794a9ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:14.713853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8650d-d4f6-423d-a6b2-23e794a9ec75 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.713853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8650d-d4f6-423d-a6b2-23e794a9ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.714083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8650d-d4f6-423d-a6b2-23e794a9ec75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.714819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8650d-d4f6-423d-a6b2-23e794a9ec75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:14.716606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8650d-d4f6-423d-a6b2-23e794a9ec75 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:14.737584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f990ad9d8af54fc2a6a8b24665fe0cca', 'request_id': 'req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.739064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1189/2367] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:14.740961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8650d-d4f6-423d-a6b2-23e794a9ec75 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:14.756584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f990ad9d8af54fc2a6a8b24665fe0cca', 'request_id': 'req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.760623 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8650d-d4f6-423d-a6b2-23e794a9ec75 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:14.766775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f990ad9d8af54fc2a6a8b24665fe0cca', 'request_id': 'req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.774543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:14.785997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] The token cache is being invalidate because project f990ad9d8af54fc2a6a8b24665fe0cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:14.786491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.787511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:14.795212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1179/2368] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:14 2022] DELETE /identity/v3/projects/f990ad9d8af54fc2a6a8b24665fe0cca => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:14.795212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:14.795212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.870033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6de5a3-771e-43a8-ac0d-b3d8126253ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:14.871154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6de5a3-771e-43a8-ac0d-b3d8126253ad admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.872397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6de5a3-771e-43a8-ac0d-b3d8126253ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.872848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6de5a3-771e-43a8-ac0d-b3d8126253ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.875018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6de5a3-771e-43a8-ac0d-b3d8126253ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:14.875018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6de5a3-771e-43a8-ac0d-b3d8126253ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:14.877449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6de5a3-771e-43a8-ac0d-b3d8126253ad admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:14.893039 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1190/2369] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:14.895255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f2cce-c37b-4556-a087-da0cc2dc621d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.895689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f2cce-c37b-4556-a087-da0cc2dc621d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.896102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f2cce-c37b-4556-a087-da0cc2dc621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.904804 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa10e5d-c7a7-4c87-b7d7-66dbd3b3cafa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:14.911354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae9d95-0e07-4c52-89b5-c02293632f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:14.912897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae9d95-0e07-4c52-89b5-c02293632f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.913061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae9d95-0e07-4c52-89b5-c02293632f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.913451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae9d95-0e07-4c52-89b5-c02293632f99 admin admin] PATH_INFO: `/v3/projects/001280ac0cfd49f49a21f90ed75ad4db/users/1f3610702ded48c78b10c0509b303a01/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.919225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-cb8f2cce-c37b-4556-a087-da0cc2dc621d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:14.920404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cb8f2cce-c37b-4556-a087-da0cc2dc621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.930216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1191/2370] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:14.931179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f2cce-c37b-4556-a087-da0cc2dc621d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:14.932784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cb8f2cce-c37b-4556-a087-da0cc2dc621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:14.946749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f2cce-c37b-4556-a087-da0cc2dc621d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:14.953771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd6cd9-4a49-4243-87a9-08955484b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:14.954148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae9d95-0e07-4c52-89b5-c02293632f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=001280ac0cfd49f49a21f90ed75ad4db, user_id=1f3610702ded48c78b10c0509b303a01, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:14.955231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd6cd9-4a49-4243-87a9-08955484b63e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.955821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd6cd9-4a49-4243-87a9-08955484b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.956191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd6cd9-4a49-4243-87a9-08955484b63e admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.957117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd6cd9-4a49-4243-87a9-08955484b63e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:14.957413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae9d95-0e07-4c52-89b5-c02293632f99 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:14.959584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd6cd9-4a49-4243-87a9-08955484b63e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:14.977857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1180/2371] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:14 2022] PUT /identity/v3/projects/001280ac0cfd49f49a21f90ed75ad4db/users/1f3610702ded48c78b10c0509b303a01/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:14.977857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3363cc-c70f-4329-99d0-541bf2548948 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:14.977857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3363cc-c70f-4329-99d0-541bf2548948 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:14.977857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3363cc-c70f-4329-99d0-541bf2548948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:14.998768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1e3363cc-c70f-4329-99d0-541bf2548948 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:14.999707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1e3363cc-c70f-4329-99d0-541bf2548948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:15.009266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1192/2372] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:14 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:15.010621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd6cd9-4a49-4243-87a9-08955484b63e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.028258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:15.091603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1181/2373] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:15.093080 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3363cc-c70f-4329-99d0-541bf2548948 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.107072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3363cc-c70f-4329-99d0-541bf2548948 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.108592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd6cd9-4a49-4243-87a9-08955484b63e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.114761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4c14-fa2c-4a49-805c-a07c2e8e1bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.115848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4c14-fa2c-4a49-805c-a07c2e8e1bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.116008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6b14-d195-44c4-9f28-01364d6c08fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.116367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4c14-fa2c-4a49-805c-a07c2e8e1bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.116819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb4c14-fa2c-4a49-805c-a07c2e8e1bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.116971 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6b14-d195-44c4-9f28-01364d6c08fb admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.117394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6b14-d195-44c4-9f28-01364d6c08fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.117834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6b14-d195-44c4-9f28-01364d6c08fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.118122 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4c14-fa2c-4a49-805c-a07c2e8e1bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.119326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a6b14-d195-44c4-9f28-01364d6c08fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.122410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a6b14-d195-44c4-9f28-01364d6c08fb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.122640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb4c14-fa2c-4a49-805c-a07c2e8e1bc0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.138537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1193/2374] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:15.140002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6b14-d195-44c4-9f28-01364d6c08fb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.153192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1182/2375] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:15 2022] POST /identity/v3/users => generated 282 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:15.153774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6b14-d195-44c4-9f28-01364d6c08fb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.154758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4c14-fa2c-4a49-805c-a07c2e8e1bc0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.161124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.161817 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.162154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.162378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.163180 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:15.163481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.165370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.167958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb4c14-fa2c-4a49-805c-a07c2e8e1bc0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.173429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ba6d-c6a2-4511-8391-92e912e32970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.174345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ba6d-c6a2-4511-8391-92e912e32970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.174625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ba6d-c6a2-4511-8391-92e912e32970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.174904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ba6d-c6a2-4511-8391-92e912e32970 admin admin] PATH_INFO: `/v3/projects/001280ac0cfd49f49a21f90ed75ad4db/users/1f3610702ded48c78b10c0509b303a01/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.177192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030ba6d-c6a2-4511-8391-92e912e32970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=001280ac0cfd49f49a21f90ed75ad4db, user_id=1f3610702ded48c78b10c0509b303a01, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.179768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1194/2376] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:15.179964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030ba6d-c6a2-4511-8391-92e912e32970 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.180678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.191443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b16ec-9ae6-4b64-b648-e582f4221553 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.191716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1183/2377] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:15 2022] PUT /identity/v3/projects/001280ac0cfd49f49a21f90ed75ad4db/users/1f3610702ded48c78b10c0509b303a01/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:15.192679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ba6d-c6a2-4511-8391-92e912e32970 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.277437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ba6d-c6a2-4511-8391-92e912e32970 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.280491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0185-4cfe-4f19-9f4d-c49c54250924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.281251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0185-4cfe-4f19-9f4d-c49c54250924 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.281594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0185-4cfe-4f19-9f4d-c49c54250924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.282661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0185-4cfe-4f19-9f4d-c49c54250924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.282661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df0185-4cfe-4f19-9f4d-c49c54250924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.283024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895d67f-e0f2-46ff-86ed-4656e8ba3a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.283735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895d67f-e0f2-46ff-86ed-4656e8ba3a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.284093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895d67f-e0f2-46ff-86ed-4656e8ba3a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.284437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895d67f-e0f2-46ff-86ed-4656e8ba3a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.284775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df0185-4cfe-4f19-9f4d-c49c54250924 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.286204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895d67f-e0f2-46ff-86ed-4656e8ba3a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.286370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:15.287485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895d67f-e0f2-46ff-86ed-4656e8ba3a37 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.297794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1195/2378] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:15.300006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1c434-43b9-4b4b-a94b-0d2b3e1a41d3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.301704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1c434-43b9-4b4b-a94b-0d2b3e1a41d3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.301704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1c434-43b9-4b4b-a94b-0d2b3e1a41d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.327226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1184/2379] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:15 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:15.328306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895d67f-e0f2-46ff-86ed-4656e8ba3a37 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.347751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-aea1c434-43b9-4b4b-a94b-0d2b3e1a41d3 None None] MFA Rules not processed for user `1f3610702ded48c78b10c0509b303a01`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:15.349299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-aea1c434-43b9-4b4b-a94b-0d2b3e1a41d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:15.426565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895d67f-e0f2-46ff-86ed-4656e8ba3a37 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.436386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8494-3a2c-4cde-a3f4-1f321bb1d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.437301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8494-3a2c-4cde-a3f4-1f321bb1d690 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.438704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8494-3a2c-4cde-a3f4-1f321bb1d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.439284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8494-3a2c-4cde-a3f4-1f321bb1d690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.440224 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8494-3a2c-4cde-a3f4-1f321bb1d690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.443367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8494-3a2c-4cde-a3f4-1f321bb1d690 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.456541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1185/2380] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:15.457514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8494-3a2c-4cde-a3f4-1f321bb1d690 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.459386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1196/2381] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:15.464705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1c434-43b9-4b4b-a94b-0d2b3e1a41d3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.470243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8494-3a2c-4cde-a3f4-1f321bb1d690 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.474933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.475643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.475946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.476219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.476914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.479680 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.483679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1c434-43b9-4b4b-a94b-0d2b3e1a41d3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.488878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58556f-ae43-47e3-94ba-20e0c2df1b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.489939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58556f-ae43-47e3-94ba-20e0c2df1b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.490311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58556f-ae43-47e3-94ba-20e0c2df1b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.490705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58556f-ae43-47e3-94ba-20e0c2df1b52 admin admin] PATH_INFO: `/v3/projects/b6f6366a30094c5d8ebf8b354135affe/users/d3d05ddacc2a44d180ecd766c03af3dc/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.499663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:15.510379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1186/2382] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:15 2022] POST /identity/v3/users => generated 291 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:15.510379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.513007 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:15.516104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58556f-ae43-47e3-94ba-20e0c2df1b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f6366a30094c5d8ebf8b354135affe, user_id=d3d05ddacc2a44d180ecd766c03af3dc, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.519233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58556f-ae43-47e3-94ba-20e0c2df1b52 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.536282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1197/2383] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:15 2022] PUT /identity/v3/projects/b6f6366a30094c5d8ebf8b354135affe/users/d3d05ddacc2a44d180ecd766c03af3dc/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:15.548090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58556f-ae43-47e3-94ba-20e0c2df1b52 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.582094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bb8da-a78f-4cbc-ae26-317566ae3ddf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.635586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58556f-ae43-47e3-94ba-20e0c2df1b52 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.640642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37817c03-64c5-43b1-92f1-5ea804a35f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.641331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817c03-64c5-43b1-92f1-5ea804a35f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.641643 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817c03-64c5-43b1-92f1-5ea804a35f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.641964 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817c03-64c5-43b1-92f1-5ea804a35f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.642583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37817c03-64c5-43b1-92f1-5ea804a35f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.645413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37817c03-64c5-43b1-92f1-5ea804a35f73 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.657800 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1198/2384] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:15.659374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be915d-47a9-4630-8c3b-f066646a1f17 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.659763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be915d-47a9-4630-8c3b-f066646a1f17 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.660229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be915d-47a9-4630-8c3b-f066646a1f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.686170 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.686841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.687147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.687429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.689346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:15.694506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-92be915d-47a9-4630-8c3b-f066646a1f17 None None] MFA Rules not processed for user `d3d05ddacc2a44d180ecd766c03af3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:15.695871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-92be915d-47a9-4630-8c3b-f066646a1f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:15.757159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:15.776201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.777832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.787052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1199/2385] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:15.787968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be915d-47a9-4630-8c3b-f066646a1f17 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.788457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1187/2386] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:15.803369 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.805236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:15.808313 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be915d-47a9-4630-8c3b-f066646a1f17 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.814320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f698846-f994-4af0-806e-475b9cb9483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.815253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f698846-f994-4af0-806e-475b9cb9483a admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.815703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f698846-f994-4af0-806e-475b9cb9483a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.816104 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f698846-f994-4af0-806e-475b9cb9483a admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.816859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f698846-f994-4af0-806e-475b9cb9483a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.817404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664791c9-d93e-4116-b997-f8d44f15691d service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.818805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f698846-f994-4af0-806e-475b9cb9483a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.822026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51caca-f006-41e8-a45f-f531d214e678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.822501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51caca-f006-41e8-a45f-f531d214e678 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.822848 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51caca-f006-41e8-a45f-f531d214e678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.823224 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51caca-f006-41e8-a45f-f531d214e678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.835920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1200/2387] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:15.836194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51caca-f006-41e8-a45f-f531d214e678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.836194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51caca-f006-41e8-a45f-f531d214e678 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.837554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f698846-f994-4af0-806e-475b9cb9483a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:15.847175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1188/2388] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:15.855224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f698846-f994-4af0-806e-475b9cb9483a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:15.861880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:15.862787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.863278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.863685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] PATH_INFO: `/v3/projects/a56764b8ffae4441a74af5d9b3991bc8/users/091cd0c1f4fd40a1a362879e97e0966f/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.883728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56764b8ffae4441a74af5d9b3991bc8, user_id=091cd0c1f4fd40a1a362879e97e0966f, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:15.887185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:15.907659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1201/2389] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:15 2022] PUT /identity/v3/projects/a56764b8ffae4441a74af5d9b3991bc8/users/091cd0c1f4fd40a1a362879e97e0966f/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:15.909833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544cc42-ac70-4a8c-889f-c53d8b5dbcb4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:15.910879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544cc42-ac70-4a8c-889f-c53d8b5dbcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:15.910879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544cc42-ac70-4a8c-889f-c53d8b5dbcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:15.931328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6544cc42-ac70-4a8c-889f-c53d8b5dbcb4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:15.933274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6544cc42-ac70-4a8c-889f-c53d8b5dbcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:16.001738 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:16.019424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1189/2390] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:16.039120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:16.041794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:16.145001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750675-2b88-4ad5-a355-f9f4959858eb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:16.151436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975375e8-0075-4c1c-8cd5-e3f7200991ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:16.152517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975375e8-0075-4c1c-8cd5-e3f7200991ba service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:16.153062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975375e8-0075-4c1c-8cd5-e3f7200991ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:16.153534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975375e8-0075-4c1c-8cd5-e3f7200991ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:16.170807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975375e8-0075-4c1c-8cd5-e3f7200991ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:16.174838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975375e8-0075-4c1c-8cd5-e3f7200991ba service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:16.200589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1202/2391] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:16.373766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544cc42-ac70-4a8c-889f-c53d8b5dbcb4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:16.375296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6544cc42-ac70-4a8c-889f-c53d8b5dbcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:16.387566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544cc42-ac70-4a8c-889f-c53d8b5dbcb4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:16.392473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:16.393370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:16.393648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:16.393919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] PATH_INFO: `/v3/users/bb9dd20a22d8434391ca24b2d6ddcdfc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:16.395182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9dd20a22d8434391ca24b2d6ddcdfc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:16.397138 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:16.456918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9dd20a22d8434391ca24b2d6ddcdfc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:16.469377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9dd20a22d8434391ca24b2d6ddcdfc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:16.470473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9dd20a22d8434391ca24b2d6ddcdfc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:16.479900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9dd20a22d8434391ca24b2d6ddcdfc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:16.480958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9dd20a22d8434391ca24b2d6ddcdfc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:16.502912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1190/2392] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:16 2022] DELETE /identity/v3/users/bb9dd20a22d8434391ca24b2d6ddcdfc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:16.511334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0617-6625-4702-a1a6-70c9b9ef0da7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:16.512052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0617-6625-4702-a1a6-70c9b9ef0da7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:16.512568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0617-6625-4702-a1a6-70c9b9ef0da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:16.536285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c5cb0617-6625-4702-a1a6-70c9b9ef0da7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:16.543707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c5cb0617-6625-4702-a1a6-70c9b9ef0da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:16.639170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1203/2393] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:16.643771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:16.646282 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:16.732798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae1ce0-9ee8-48a6-bfcf-d2cbc051bbd0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:16.736933 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:16.737648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:16.737915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:16.738185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:16.751906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:16.753383 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:16.767619 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1191/2394] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:17.070127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e5b73-ff17-430e-9080-40de5f80809c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.070381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e5b73-ff17-430e-9080-40de5f80809c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.070639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e5b73-ff17-430e-9080-40de5f80809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.121533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c20e5b73-ff17-430e-9080-40de5f80809c None None] MFA Rules not processed for user `091cd0c1f4fd40a1a362879e97e0966f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:17.125805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c20e5b73-ff17-430e-9080-40de5f80809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:17.160070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:17.163508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:17.209921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:17.247446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1204/2395] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:17.251670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d036c07-bfa1-4fee-b2ad-f7636b17be83 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:17.257859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:17.258872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.259322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.259694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] PATH_INFO: `/v3/projects/ade99499594b43e09935c9346af2845f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.261555 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade99499594b43e09935c9346af2845f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:17.264409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:17.291429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e5b73-ff17-430e-9080-40de5f80809c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:17.293057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c20e5b73-ff17-430e-9080-40de5f80809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:17.329348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade99499594b43e09935c9346af2845f', 'request_id': 'req-b6324a45-8fd4-4b11-93b7-8cd3a718b591'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:17.343436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade99499594b43e09935c9346af2845f', 'request_id': 'req-b6324a45-8fd4-4b11-93b7-8cd3a718b591'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:17.352032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade99499594b43e09935c9346af2845f', 'request_id': 'req-b6324a45-8fd4-4b11-93b7-8cd3a718b591'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:17.353336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:17.374344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] The token cache is being invalidate because project ade99499594b43e09935c9346af2845f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:17.374641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:17.375373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b6324a45-8fd4-4b11-93b7-8cd3a718b591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:17.376937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1192/2396] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:17 2022] DELETE /identity/v3/projects/ade99499594b43e09935c9346af2845f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:17.381770 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb72322-0541-4e7b-8271-d50c0b076dfb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.382121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb72322-0541-4e7b-8271-d50c0b076dfb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.382470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb72322-0541-4e7b-8271-d50c0b076dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.390621 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e5b73-ff17-430e-9080-40de5f80809c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:17.404219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9cb72322-0541-4e7b-8271-d50c0b076dfb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:17.405689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9cb72322-0541-4e7b-8271-d50c0b076dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:17.455917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:17.456667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.457014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.457356 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.459352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:17.490216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1193/2397] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:17.494886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bbfc-51c2-46ab-8c2f-d67efcdf35eb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.495381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bbfc-51c2-46ab-8c2f-d67efcdf35eb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.495656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bbfc-51c2-46ab-8c2f-d67efcdf35eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.526953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3604bbfc-51c2-46ab-8c2f-d67efcdf35eb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:17.528769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3604bbfc-51c2-46ab-8c2f-d67efcdf35eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:17.543863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1194/2398] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:17.544124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:17.544824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:17.545498 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bbfc-51c2-46ab-8c2f-d67efcdf35eb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:17.555524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1205/2399] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:17.556533 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bbfc-51c2-46ab-8c2f-d67efcdf35eb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:17.563153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:17.564059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.564404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.564755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.565664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:17.566217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:17.569211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:17.591014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1195/2400] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:30:17.595448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:17.606738 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097779e4-2ce3-4e76-ab66-ef61226a121d service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:17.611775 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52ad1-e46b-4158-b739-658894f93f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:17.612611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52ad1-e46b-4158-b739-658894f93f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.612890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52ad1-e46b-4158-b739-658894f93f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.613163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52ad1-e46b-4158-b739-658894f93f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.614102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce52ad1-e46b-4158-b739-658894f93f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:17.616713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce52ad1-e46b-4158-b739-658894f93f08 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:17.655152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1206/2401] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:17 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:30:17.659970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:17.671382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5f40-2111-4ff9-808f-1708c6efe435 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:17.819600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce091b-36eb-4de0-9ccb-8575a1ca3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:17.820330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce091b-36eb-4de0-9ccb-8575a1ca3781 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.820612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce091b-36eb-4de0-9ccb-8575a1ca3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.820952 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce091b-36eb-4de0-9ccb-8575a1ca3781 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.821884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce091b-36eb-4de0-9ccb-8575a1ca3781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:17.824579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce091b-36eb-4de0-9ccb-8575a1ca3781 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:17.857560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1196/2402] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:17 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:30:17.858990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52ad1-e46b-4158-b739-658894f93f08 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:17.872927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52ad1-e46b-4158-b739-658894f93f08 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:17.885216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7970c-5adb-44c4-b4a8-69d4556bf541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:17.885216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7970c-5adb-44c4-b4a8-69d4556bf541 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.885216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7970c-5adb-44c4-b4a8-69d4556bf541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.885216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7970c-5adb-44c4-b4a8-69d4556bf541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.885636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7970c-5adb-44c4-b4a8-69d4556bf541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:17.885636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7970c-5adb-44c4-b4a8-69d4556bf541 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:17.898280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1207/2403] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:17.903070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce091b-36eb-4de0-9ccb-8575a1ca3781 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:17.914434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce091b-36eb-4de0-9ccb-8575a1ca3781 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:17.932248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45843b3-384b-4fd5-8fcb-2a8cadb73558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:17.933158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45843b3-384b-4fd5-8fcb-2a8cadb73558 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.933581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45843b3-384b-4fd5-8fcb-2a8cadb73558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.934034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45843b3-384b-4fd5-8fcb-2a8cadb73558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:17.934905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45843b3-384b-4fd5-8fcb-2a8cadb73558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:17.937382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45843b3-384b-4fd5-8fcb-2a8cadb73558 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:17.953832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1197/2404] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:17.957959 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7970c-5adb-44c4-b4a8-69d4556bf541 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:17.971886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7970c-5adb-44c4-b4a8-69d4556bf541 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:17.991731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:17.991731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:17.991731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:17.991731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] PATH_INFO: `/v3/projects/ed31e777d89549ccba82aba7d3871f09/users/a19d383a844742f0a67eb0fd08741f65/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:18.028669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed31e777d89549ccba82aba7d3871f09, user_id=a19d383a844742f0a67eb0fd08741f65, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:18.032095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:18.034926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:18.065094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1208/2405] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:17 2022] PUT /identity/v3/projects/ed31e777d89549ccba82aba7d3871f09/users/a19d383a844742f0a67eb0fd08741f65/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:18.075793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ca7a6-974a-4b3b-b8bd-4983881b9238 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:18.076280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ca7a6-974a-4b3b-b8bd-4983881b9238 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:18.076448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ca7a6-974a-4b3b-b8bd-4983881b9238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:18.112981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-163ca7a6-974a-4b3b-b8bd-4983881b9238 None None] MFA Rules not processed for user `a19d383a844742f0a67eb0fd08741f65`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:18.114498 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-163ca7a6-974a-4b3b-b8bd-4983881b9238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:18.163868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:18.190380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1198/2406] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:18.202628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:18.205038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:18.276877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22078d-ef6b-4da1-b18d-0c34375c18ed admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:18.283233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4fad2-88c3-40ae-90ae-d5760991c78d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac481e3d57a4b6fa07c120ca26f2e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:18.284265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4fad2-88c3-40ae-90ae-d5760991c78d service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:18.285198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4fad2-88c3-40ae-90ae-d5760991c78d service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:18.285683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4fad2-88c3-40ae-90ae-d5760991c78d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:18.299435 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4fad2-88c3-40ae-90ae-d5760991c78d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:18.301496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4fad2-88c3-40ae-90ae-d5760991c78d service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:18.317659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1209/2407] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:18.764468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ca7a6-974a-4b3b-b8bd-4983881b9238 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:18.766088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-163ca7a6-974a-4b3b-b8bd-4983881b9238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:18.841573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ca7a6-974a-4b3b-b8bd-4983881b9238 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:18.849697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:18.850753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:18.851075 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:18.851397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] PATH_INFO: `/v3/users/73f55d93f3ac400aa4ba68d7d50a14de` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:18.852885 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f55d93f3ac400aa4ba68d7d50a14de)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:18.855010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:18.910934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f55d93f3ac400aa4ba68d7d50a14de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:18.931381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f55d93f3ac400aa4ba68d7d50a14de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:18.932178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f55d93f3ac400aa4ba68d7d50a14de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:18.944148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f55d93f3ac400aa4ba68d7d50a14de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:18.949285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e55701e4-4f1c-4af4-8696-de2f1380b9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f55d93f3ac400aa4ba68d7d50a14de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:18.966356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1199/2408] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:18 2022] DELETE /identity/v3/users/73f55d93f3ac400aa4ba68d7d50a14de => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:18.970754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d89fcd-9641-44ce-832a-e5c2df75752f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:18.971303 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d89fcd-9641-44ce-832a-e5c2df75752f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:18.971568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d89fcd-9641-44ce-832a-e5c2df75752f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:18.992052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e5d89fcd-9641-44ce-832a-e5c2df75752f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:18.993353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e5d89fcd-9641-44ce-832a-e5c2df75752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:19.063339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8d98-a1ab-4f6f-a6e2-0281b225cc69 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:19.063869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8d98-a1ab-4f6f-a6e2-0281b225cc69 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:19.064492 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8d98-a1ab-4f6f-a6e2-0281b225cc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:19.093349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f7ae8d98-a1ab-4f6f-a6e2-0281b225cc69 None None] MFA Rules not processed for user `091cd0c1f4fd40a1a362879e97e0966f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:19.095992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f7ae8d98-a1ab-4f6f-a6e2-0281b225cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:19.107014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1210/2409] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:19.115341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d89fcd-9641-44ce-832a-e5c2df75752f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:19.119057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e5d89fcd-9641-44ce-832a-e5c2df75752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:19.190867 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1200/2410] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:19.232873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d89fcd-9641-44ce-832a-e5c2df75752f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:19.240262 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48645cd-63c6-4def-9abe-584d5ca708de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:19.240835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48645cd-63c6-4def-9abe-584d5ca708de service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:19.241120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48645cd-63c6-4def-9abe-584d5ca708de service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:19.241451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48645cd-63c6-4def-9abe-584d5ca708de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:19.265028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48645cd-63c6-4def-9abe-584d5ca708de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:19.266652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48645cd-63c6-4def-9abe-584d5ca708de service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:19.281686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1211/2411] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:19.862755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8d98-a1ab-4f6f-a6e2-0281b225cc69 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:19.864996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f7ae8d98-a1ab-4f6f-a6e2-0281b225cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:19.889203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8d98-a1ab-4f6f-a6e2-0281b225cc69 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:19.896147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:19.897044 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:19.897327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:19.897599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] PATH_INFO: `/v3/projects/4cf29c9acc7347b88ba0b790cb487298` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:19.899323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf29c9acc7347b88ba0b790cb487298)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:19.901296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:19.903559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:20.006335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf29c9acc7347b88ba0b790cb487298', 'request_id': 'req-768ec988-a716-40fb-ae88-a1248fec456d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.020999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf29c9acc7347b88ba0b790cb487298', 'request_id': 'req-768ec988-a716-40fb-ae88-a1248fec456d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.031400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf29c9acc7347b88ba0b790cb487298', 'request_id': 'req-768ec988-a716-40fb-ae88-a1248fec456d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.045395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] The token cache is being invalidate because project 4cf29c9acc7347b88ba0b790cb487298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:20.045760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.046674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.048928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1201/2412] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:19 2022] DELETE /identity/v3/projects/4cf29c9acc7347b88ba0b790cb487298 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:20.053120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48645cd-63c6-4def-9abe-584d5ca708de service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:20.065089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48645cd-63c6-4def-9abe-584d5ca708de service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:20.114169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:20.143173 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:20.144153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:20.144459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:20.144746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] PATH_INFO: `/v3/users/1f3610702ded48c78b10c0509b303a01` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:20.145994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3610702ded48c78b10c0509b303a01)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:20.148050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:20.232908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3610702ded48c78b10c0509b303a01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.254850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3610702ded48c78b10c0509b303a01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.254850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3610702ded48c78b10c0509b303a01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.255531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3610702ded48c78b10c0509b303a01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.268116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-70f50973-cbde-4868-9b1e-d0b41692faec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3610702ded48c78b10c0509b303a01'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:20.301190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1212/2413] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:20 2022] DELETE /identity/v3/users/1f3610702ded48c78b10c0509b303a01 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:20.786812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:20.789213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:20.809290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ec988-a716-40fb-ae88-a1248fec456d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:20.991888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:20.997168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:20.997296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:20.997579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] PATH_INFO: `/v3/projects/001280ac0cfd49f49a21f90ed75ad4db` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:20.999070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=001280ac0cfd49f49a21f90ed75ad4db)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:21.001076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:21.137678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001280ac0cfd49f49a21f90ed75ad4db', 'request_id': 'req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:21.149911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001280ac0cfd49f49a21f90ed75ad4db', 'request_id': 'req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:21.160382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001280ac0cfd49f49a21f90ed75ad4db', 'request_id': 'req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:21.185463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] The token cache is being invalidate because project 001280ac0cfd49f49a21f90ed75ad4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:21.185858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:21.186575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1c4dec3d-9b04-40dc-ab21-dc6a42ecb787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:21.188941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1202/2414] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:20 2022] DELETE /identity/v3/projects/001280ac0cfd49f49a21f90ed75ad4db => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:21.195297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512913-4d36-470a-b7ed-a32c8512279c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.195632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512913-4d36-470a-b7ed-a32c8512279c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.195970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512913-4d36-470a-b7ed-a32c8512279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.218044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-af512913-4d36-470a-b7ed-a32c8512279c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:21.219714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af512913-4d36-470a-b7ed-a32c8512279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:21.300269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1213/2415] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:21.308697 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029c8a5-330d-4b17-b177-9de18477675f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.309066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029c8a5-330d-4b17-b177-9de18477675f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.309399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029c8a5-330d-4b17-b177-9de18477675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.347783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7029c8a5-330d-4b17-b177-9de18477675f None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:21.347783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7029c8a5-330d-4b17-b177-9de18477675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:21.358177 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1203/2416] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:21.362595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af512913-4d36-470a-b7ed-a32c8512279c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:21.375047 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af512913-4d36-470a-b7ed-a32c8512279c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:21.381258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:21.382110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.382532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.382958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.383787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:21.384161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:21.385940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:21.401546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1214/2417] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:21.407953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029c8a5-330d-4b17-b177-9de18477675f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:21.419292 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029c8a5-330d-4b17-b177-9de18477675f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:21.428429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ee81b-3cad-4c21-a669-ede8c921e956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:21.429099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee81b-3cad-4c21-a669-ede8c921e956 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.429400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee81b-3cad-4c21-a669-ede8c921e956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.429647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee81b-3cad-4c21-a669-ede8c921e956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.430400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ee81b-3cad-4c21-a669-ede8c921e956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:21.432517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ee81b-3cad-4c21-a669-ede8c921e956 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:21.445810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:21.471025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1204/2418] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:21 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:21.475733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:21.490386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1db86-8c15-463b-a3f4-8c38d711c941 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:21.551616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:21.576406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e3e78-1233-4b7d-9378-14a9f2f373ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:21.576406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e3e78-1233-4b7d-9378-14a9f2f373ec admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.576406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e3e78-1233-4b7d-9378-14a9f2f373ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.576406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e3e78-1233-4b7d-9378-14a9f2f373ec admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.578704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e3e78-1233-4b7d-9378-14a9f2f373ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:21.580449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e3e78-1233-4b7d-9378-14a9f2f373ec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:21.615533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1215/2419] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:21 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:21.617172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ee81b-3cad-4c21-a669-ede8c921e956 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:21.634460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ee81b-3cad-4c21-a669-ede8c921e956 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:21.641150 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055a062-db21-447d-83db-5263f7e5834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:21.642255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055a062-db21-447d-83db-5263f7e5834b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.642546 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055a062-db21-447d-83db-5263f7e5834b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.642832 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055a062-db21-447d-83db-5263f7e5834b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.643899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055a062-db21-447d-83db-5263f7e5834b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:21.645625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055a062-db21-447d-83db-5263f7e5834b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:21.670944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1205/2420] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:21.673284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e3e78-1233-4b7d-9378-14a9f2f373ec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:21.688644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e3e78-1233-4b7d-9378-14a9f2f373ec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:21.694699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c3ce8-d597-406f-900a-9061595a5601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:21.695628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c3ce8-d597-406f-900a-9061595a5601 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.696049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c3ce8-d597-406f-900a-9061595a5601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.696391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c3ce8-d597-406f-900a-9061595a5601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.697287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c3ce8-d597-406f-900a-9061595a5601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:21.700028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c3ce8-d597-406f-900a-9061595a5601 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:21.718498 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1216/2421] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:21.725109 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055a062-db21-447d-83db-5263f7e5834b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:21.741582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055a062-db21-447d-83db-5263f7e5834b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:21.751201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ddc7-bb2d-48a1-8373-d8b6eaaf6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:21.752325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ddc7-bb2d-48a1-8373-d8b6eaaf6699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.752325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ddc7-bb2d-48a1-8373-d8b6eaaf6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.752325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551ddc7-bb2d-48a1-8373-d8b6eaaf6699 admin admin] PATH_INFO: `/v3/projects/4e333355b2e9472589dc56feafe1c7d2/users/230671e37c8e4c12b7892a8a65a2626a/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.792430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551ddc7-bb2d-48a1-8373-d8b6eaaf6699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e333355b2e9472589dc56feafe1c7d2, user_id=230671e37c8e4c12b7892a8a65a2626a, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:21.796509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551ddc7-bb2d-48a1-8373-d8b6eaaf6699 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:21.819408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1206/2422] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:21 2022] PUT /identity/v3/projects/4e333355b2e9472589dc56feafe1c7d2/users/230671e37c8e4c12b7892a8a65a2626a/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:21.901363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb223ae-5292-4a06-a279-ab0a678b24fd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:21.901672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb223ae-5292-4a06-a279-ab0a678b24fd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:21.902087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb223ae-5292-4a06-a279-ab0a678b24fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:21.946802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-afb223ae-5292-4a06-a279-ab0a678b24fd None None] MFA Rules not processed for user `230671e37c8e4c12b7892a8a65a2626a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:21.946802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-afb223ae-5292-4a06-a279-ab0a678b24fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:22.065776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1217/2423] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:22.066624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ddc7-bb2d-48a1-8373-d8b6eaaf6699 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.198290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551ddc7-bb2d-48a1-8373-d8b6eaaf6699 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.204678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efcc9a-4afa-42f6-9d8a-a04aeb43f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.206085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efcc9a-4afa-42f6-9d8a-a04aeb43f649 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.207704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efcc9a-4afa-42f6-9d8a-a04aeb43f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.208198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efcc9a-4afa-42f6-9d8a-a04aeb43f649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.209178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efcc9a-4afa-42f6-9d8a-a04aeb43f649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.211753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efcc9a-4afa-42f6-9d8a-a04aeb43f649 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.262254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb223ae-5292-4a06-a279-ab0a678b24fd None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.274022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1207/2424] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:30:22.281414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb223ae-5292-4a06-a279-ab0a678b24fd None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.429559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf65c9-3ff3-4124-b9e5-0e72d83d0860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.430316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf65c9-3ff3-4124-b9e5-0e72d83d0860 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.430741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf65c9-3ff3-4124-b9e5-0e72d83d0860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.431117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf65c9-3ff3-4124-b9e5-0e72d83d0860 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.432049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf65c9-3ff3-4124-b9e5-0e72d83d0860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.435282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf65c9-3ff3-4124-b9e5-0e72d83d0860 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.463017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1218/2425] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:22.466111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efcc9a-4afa-42f6-9d8a-a04aeb43f649 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.480030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efcc9a-4afa-42f6-9d8a-a04aeb43f649 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.486632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907301c-a4d4-4c38-997c-ae92c0bab76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.487860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907301c-a4d4-4c38-997c-ae92c0bab76c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.488329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907301c-a4d4-4c38-997c-ae92c0bab76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.488758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907301c-a4d4-4c38-997c-ae92c0bab76c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.489753 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907301c-a4d4-4c38-997c-ae92c0bab76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.491683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907301c-a4d4-4c38-997c-ae92c0bab76c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.505446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1208/2426] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:22.509687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf65c9-3ff3-4124-b9e5-0e72d83d0860 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.522520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf65c9-3ff3-4124-b9e5-0e72d83d0860 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.531792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746d16f-abfd-4eca-a200-291219a0c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.532634 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d16f-abfd-4eca-a200-291219a0c4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.533026 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d16f-abfd-4eca-a200-291219a0c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.533372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746d16f-abfd-4eca-a200-291219a0c4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.534219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d16f-abfd-4eca-a200-291219a0c4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.536024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746d16f-abfd-4eca-a200-291219a0c4f8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.547693 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1219/2427] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:22.552495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907301c-a4d4-4c38-997c-ae92c0bab76c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.565678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907301c-a4d4-4c38-997c-ae92c0bab76c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.571083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4106-1a06-468c-ac1d-dd4899f7fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.572191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4106-1a06-468c-ac1d-dd4899f7fa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.572504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4106-1a06-468c-ac1d-dd4899f7fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.572877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4106-1a06-468c-ac1d-dd4899f7fa5a admin admin] PATH_INFO: `/v3/projects/3d09230312ea40b89ec0c6c56c27d38c/users/f603dadf387d4f42bf42edfc0628e672/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.589657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4106-1a06-468c-ac1d-dd4899f7fa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d09230312ea40b89ec0c6c56c27d38c, user_id=f603dadf387d4f42bf42edfc0628e672, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.592626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4106-1a06-468c-ac1d-dd4899f7fa5a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.610893 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1209/2428] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:22 2022] PUT /identity/v3/projects/3d09230312ea40b89ec0c6c56c27d38c/users/f603dadf387d4f42bf42edfc0628e672/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:22.622688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3381c6d-33c6-4c3e-992b-86af3db97c70 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.623503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3381c6d-33c6-4c3e-992b-86af3db97c70 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.623699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3381c6d-33c6-4c3e-992b-86af3db97c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.653532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d3381c6d-33c6-4c3e-992b-86af3db97c70 None None] MFA Rules not processed for user `f603dadf387d4f42bf42edfc0628e672`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:22.654761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d3381c6d-33c6-4c3e-992b-86af3db97c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:22.689649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:22.752546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1220/2429] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:22.757705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4106-1a06-468c-ac1d-dd4899f7fa5a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.782757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3381c6d-33c6-4c3e-992b-86af3db97c70 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.784455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d3381c6d-33c6-4c3e-992b-86af3db97c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:22.851641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4106-1a06-468c-ac1d-dd4899f7fa5a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.859523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ad9e-a3d4-460e-8dd3-78e5281b3e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.860378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ad9e-a3d4-460e-8dd3-78e5281b3e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.860666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ad9e-a3d4-460e-8dd3-78e5281b3e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.861210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ad9e-a3d4-460e-8dd3-78e5281b3e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.862368 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ad9e-a3d4-460e-8dd3-78e5281b3e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.864357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ad9e-a3d4-460e-8dd3-78e5281b3e83 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.885721 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:22.887834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3381c6d-33c6-4c3e-992b-86af3db97c70 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.895736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.896710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.897033 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.897326 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] PATH_INFO: `/v3/users/5ee6fc0a7b5a45a09a524cc6562cb77b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.898740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee6fc0a7b5a45a09a524cc6562cb77b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.900858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.911428 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1210/2430] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:22.915212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ad9e-a3d4-460e-8dd3-78e5281b3e83 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.992207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee6fc0a7b5a45a09a524cc6562cb77b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.017038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee6fc0a7b5a45a09a524cc6562cb77b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.018125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ad9e-a3d4-460e-8dd3-78e5281b3e83 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.018704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee6fc0a7b5a45a09a524cc6562cb77b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.019534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee6fc0a7b5a45a09a524cc6562cb77b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.023934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.024667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.025048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.025389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.026345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.028622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.034044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee6fc0a7b5a45a09a524cc6562cb77b'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.053743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1211/2431] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:23.055833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1221/2432] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:22 2022] DELETE /identity/v3/users/5ee6fc0a7b5a45a09a524cc6562cb77b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:23.069144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.071376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.092591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e4f1b-1d43-4011-8b32-c99b31bb19c9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.191705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.192595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.192886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.193159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.193905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.195604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.218140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1212/2433] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:23.222339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.236190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe062-232b-4b1d-982a-20e69df07555 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.240925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82f24-139c-4a3f-b3d6-126839207009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.242058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f24-139c-4a3f-b3d6-126839207009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.242410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f24-139c-4a3f-b3d6-126839207009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.243159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f24-139c-4a3f-b3d6-126839207009 admin admin] PATH_INFO: `/v3/projects/97b3a302becb4b1e8381b3a2c87fcf1f/users/e508b6cfe5364d16aa7975616a1c35e3/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.262866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d82f24-139c-4a3f-b3d6-126839207009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b3a302becb4b1e8381b3a2c87fcf1f, user_id=e508b6cfe5364d16aa7975616a1c35e3, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.266422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d82f24-139c-4a3f-b3d6-126839207009 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.282410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.284316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.327010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdace8-ab16-4d3f-8c81-47491b841e62 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.331714 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1222/2434] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:23 2022] PUT /identity/v3/projects/97b3a302becb4b1e8381b3a2c87fcf1f/users/e508b6cfe5364d16aa7975616a1c35e3/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:23.336193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82f24-139c-4a3f-b3d6-126839207009 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.379368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:23.432000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.432550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.432852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.433096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] PATH_INFO: `/v3/projects/3853d65bed914b779e921f3f24b1c157` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.435796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3853d65bed914b779e921f3f24b1c157)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.438001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.456636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d82f24-139c-4a3f-b3d6-126839207009 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.461649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708974ea-8c82-4d03-a161-d2bdc27208a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.464379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708974ea-8c82-4d03-a161-d2bdc27208a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.464379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708974ea-8c82-4d03-a161-d2bdc27208a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.464379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708974ea-8c82-4d03-a161-d2bdc27208a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.464379 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708974ea-8c82-4d03-a161-d2bdc27208a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.466314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708974ea-8c82-4d03-a161-d2bdc27208a1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.469874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:23.495782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1223/2435] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:23.503251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708974ea-8c82-4d03-a161-d2bdc27208a1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.518555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708974ea-8c82-4d03-a161-d2bdc27208a1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.527408 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3853d65bed914b779e921f3f24b1c157', 'request_id': 'req-9313abe2-30a6-40a4-bde6-7c7bec3938e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.539677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3853d65bed914b779e921f3f24b1c157', 'request_id': 'req-9313abe2-30a6-40a4-bde6-7c7bec3938e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.550466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3853d65bed914b779e921f3f24b1c157', 'request_id': 'req-9313abe2-30a6-40a4-bde6-7c7bec3938e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.569061 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] The token cache is being invalidate because project 3853d65bed914b779e921f3f24b1c157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:23.569447 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.570380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.575581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1213/2436] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:23 2022] DELETE /identity/v3/projects/3853d65bed914b779e921f3f24b1c157 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:23.580455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.584040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.646271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b5b2-a9ed-405c-8c8d-e36377edcff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.647805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b5b2-a9ed-405c-8c8d-e36377edcff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.649134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b5b2-a9ed-405c-8c8d-e36377edcff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.649779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b5b2-a9ed-405c-8c8d-e36377edcff7 admin admin] PATH_INFO: `/v3/projects/97b3a302becb4b1e8381b3a2c87fcf1f/users/e508b6cfe5364d16aa7975616a1c35e3/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.653198 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7b5b2-a9ed-405c-8c8d-e36377edcff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b3a302becb4b1e8381b3a2c87fcf1f, user_id=e508b6cfe5364d16aa7975616a1c35e3, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.657345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7b5b2-a9ed-405c-8c8d-e36377edcff7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.690612 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1224/2437] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:23 2022] PUT /identity/v3/projects/97b3a302becb4b1e8381b3a2c87fcf1f/users/e508b6cfe5364d16aa7975616a1c35e3/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:23.692995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf79d8d-2367-48c5-9aa0-ea9df00a581f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.693287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf79d8d-2367-48c5-9aa0-ea9df00a581f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.693561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf79d8d-2367-48c5-9aa0-ea9df00a581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.696226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313abe2-30a6-40a4-bde6-7c7bec3938e9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.731306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-bcf79d8d-2367-48c5-9aa0-ea9df00a581f None None] MFA Rules not processed for user `e508b6cfe5364d16aa7975616a1c35e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.732976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bcf79d8d-2367-48c5-9aa0-ea9df00a581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.807776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.808944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.809323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.809700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] PATH_INFO: `/v3/users/3d192fa087f94e20a4f7ee6f8b883a85` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.811131 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d192fa087f94e20a4f7ee6f8b883a85)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.813177 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.876822 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1225/2438] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.877993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf79d8d-2367-48c5-9aa0-ea9df00a581f None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.882206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bcf79d8d-2367-48c5-9aa0-ea9df00a581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.883758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d192fa087f94e20a4f7ee6f8b883a85'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.894305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:23.911946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d192fa087f94e20a4f7ee6f8b883a85'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.913586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d192fa087f94e20a4f7ee6f8b883a85'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.931642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:23.934376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d192fa087f94e20a4f7ee6f8b883a85'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.935533 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d192fa087f94e20a4f7ee6f8b883a85'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:23.970269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf79d8d-2367-48c5-9aa0-ea9df00a581f None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.974405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1214/2439] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:23 2022] DELETE /identity/v3/users/3d192fa087f94e20a4f7ee6f8b883a85 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:24.088807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd211185-506c-4411-86ae-f93474f5a992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.089716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd211185-506c-4411-86ae-f93474f5a992 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.090249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd211185-506c-4411-86ae-f93474f5a992 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.091127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd211185-506c-4411-86ae-f93474f5a992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.093712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-cd211185-506c-4411-86ae-f93474f5a992 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:24.195071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd211185-506c-4411-86ae-f93474f5a992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.197190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd211185-506c-4411-86ae-f93474f5a992 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.208736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1226/2440] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:24.257595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.259335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:24.347923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcf513-1c0b-4dad-a19c-47f9ec103f22 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.354807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.354807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.354807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.354807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] PATH_INFO: `/v3/projects/8099b520e6db46c7acfca8ff96565d8f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.357040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8099b520e6db46c7acfca8ff96565d8f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.359153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.459155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8099b520e6db46c7acfca8ff96565d8f', 'request_id': 'req-e8cc2d74-0c79-4f42-810b-d35617e5548c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:24.473700 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8099b520e6db46c7acfca8ff96565d8f', 'request_id': 'req-e8cc2d74-0c79-4f42-810b-d35617e5548c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:24.484316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8099b520e6db46c7acfca8ff96565d8f', 'request_id': 'req-e8cc2d74-0c79-4f42-810b-d35617e5548c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:24.508526 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] The token cache is being invalidate because project 8099b520e6db46c7acfca8ff96565d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:24.509108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:24.510026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e8cc2d74-0c79-4f42-810b-d35617e5548c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:24.512919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1215/2441] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:24 2022] DELETE /identity/v3/projects/8099b520e6db46c7acfca8ff96565d8f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:24.518847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390baeaf-4294-4791-9f31-3198685138ef None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.519465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390baeaf-4294-4791-9f31-3198685138ef None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.520030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390baeaf-4294-4791-9f31-3198685138ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.546140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-390baeaf-4294-4791-9f31-3198685138ef None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:24.547739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-390baeaf-4294-4791-9f31-3198685138ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:24.673575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1227/2442] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:24.682836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8e9e-5621-4ad5-9b79-a5fb3d16458e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.683852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8e9e-5621-4ad5-9b79-a5fb3d16458e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.684204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8e9e-5621-4ad5-9b79-a5fb3d16458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.718211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ff2e8e9e-5621-4ad5-9b79-a5fb3d16458e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:24.719833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ff2e8e9e-5621-4ad5-9b79-a5fb3d16458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:24.730243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1216/2443] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:24.734848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390baeaf-4294-4791-9f31-3198685138ef None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.750242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390baeaf-4294-4791-9f31-3198685138ef None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.757144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.757964 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.758452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.758786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.759705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:24.760008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.762739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.787040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1228/2444] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:24.789083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e8e9e-5621-4ad5-9b79-a5fb3d16458e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.799818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e8e9e-5621-4ad5-9b79-a5fb3d16458e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.806156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3457-0d83-48c8-b915-a49e3ca64ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.806905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3457-0d83-48c8-b915-a49e3ca64ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.807222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3457-0d83-48c8-b915-a49e3ca64ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.807502 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c3457-0d83-48c8-b915-a49e3ca64ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.808206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c3457-0d83-48c8-b915-a49e3ca64ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.810205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c3457-0d83-48c8-b915-a49e3ca64ab4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.854036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1217/2445] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.858487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.875166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b554-1e8f-4e8c-a207-be8421ba499d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.916578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:24.955946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66053a-9c0b-4b64-9af7-e8a5e56b98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.956462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66053a-9c0b-4b64-9af7-e8a5e56b98d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.956746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66053a-9c0b-4b64-9af7-e8a5e56b98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.957021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66053a-9c0b-4b64-9af7-e8a5e56b98d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.957718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66053a-9c0b-4b64-9af7-e8a5e56b98d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.959834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66053a-9c0b-4b64-9af7-e8a5e56b98d4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.995558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1229/2446] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:25.000945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3457-0d83-48c8-b915-a49e3ca64ab4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.015528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c3457-0d83-48c8-b915-a49e3ca64ab4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.022708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9f2cd-aef0-45db-bb25-7b4686f23f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.023479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f2cd-aef0-45db-bb25-7b4686f23f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.023757 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f2cd-aef0-45db-bb25-7b4686f23f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.024023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f2cd-aef0-45db-bb25-7b4686f23f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.024790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9f2cd-aef0-45db-bb25-7b4686f23f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.027151 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9f2cd-aef0-45db-bb25-7b4686f23f48 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.044763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1218/2447] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.046413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66053a-9c0b-4b64-9af7-e8a5e56b98d4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.058537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66053a-9c0b-4b64-9af7-e8a5e56b98d4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.065179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138f3fc-dc41-4653-9435-72d55627b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.066134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f3fc-dc41-4653-9435-72d55627b7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.066497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f3fc-dc41-4653-9435-72d55627b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.066841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f3fc-dc41-4653-9435-72d55627b7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.067865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138f3fc-dc41-4653-9435-72d55627b7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.069841 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138f3fc-dc41-4653-9435-72d55627b7f9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.084087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1230/2448] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.089663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9f2cd-aef0-45db-bb25-7b4686f23f48 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.102452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9f2cd-aef0-45db-bb25-7b4686f23f48 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.107944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.108974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.109255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.109609 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] PATH_INFO: `/v3/projects/ac2153d1c1ee455d9029647ee282a328/users/0aea7e7855644a74a69323337815a272/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.135295 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2153d1c1ee455d9029647ee282a328, user_id=0aea7e7855644a74a69323337815a272, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.138229 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.153411 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:25.164439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1219/2449] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:25 2022] PUT /identity/v3/projects/ac2153d1c1ee455d9029647ee282a328/users/0aea7e7855644a74a69323337815a272/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:25.176910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b2aa-ff0f-45ba-adc9-32407d1b20a9 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.177120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b2aa-ff0f-45ba-adc9-32407d1b20a9 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.177611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b2aa-ff0f-45ba-adc9-32407d1b20a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.226276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c2d2b2aa-ff0f-45ba-adc9-32407d1b20a9 None None] MFA Rules not processed for user `0aea7e7855644a74a69323337815a272`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:25.227821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c2d2b2aa-ff0f-45ba-adc9-32407d1b20a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:25.324925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1231/2450] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:25.338874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.341096 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:25.455739 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8ea6b-15d9-4268-a6f1-e982f70e9c37 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.462000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27afc-3abb-4521-8206-991d1f9d53b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac481e3d57a4b6fa07c120ca26f2e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.462723 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27afc-3abb-4521-8206-991d1f9d53b3 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.463049 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27afc-3abb-4521-8206-991d1f9d53b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.463334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27afc-3abb-4521-8206-991d1f9d53b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.485647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e27afc-3abb-4521-8206-991d1f9d53b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.495104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e27afc-3abb-4521-8206-991d1f9d53b3 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.527966 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1220/2451] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:26.261762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2b2aa-ff0f-45ba-adc9-32407d1b20a9 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.263540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c2d2b2aa-ff0f-45ba-adc9-32407d1b20a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.336133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2b2aa-ff0f-45ba-adc9-32407d1b20a9 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.340006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.340680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.340961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.341233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.343106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.410952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:26.416763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.418386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.429345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1232/2452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:27.414941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27afc-3abb-4521-8206-991d1f9d53b3 service glance] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:27.445280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27afc-3abb-4521-8206-991d1f9d53b3 service glance] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:27.449714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f1479-8b9a-4989-aa68-b0d68fabca15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:27.450394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1479-8b9a-4989-aa68-b0d68fabca15 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.450900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1479-8b9a-4989-aa68-b0d68fabca15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.451452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1479-8b9a-4989-aa68-b0d68fabca15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.454715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d12f1479-8b9a-4989-aa68-b0d68fabca15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:27.527172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f1479-8b9a-4989-aa68-b0d68fabca15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:27.529547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f1479-8b9a-4989-aa68-b0d68fabca15 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:27.540802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1221/2453] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:31.500904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:31.502499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:31.592345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757f280-f6af-4745-9dc1-e6136334a705 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:31.598297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:31.599263 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:31.599506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:31.599786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] PATH_INFO: `/v3/users/230671e37c8e4c12b7892a8a65a2626a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:31.600985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] RBAC: Authorizing `identity:delete_user(user_id=230671e37c8e4c12b7892a8a65a2626a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:31.602998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:31.662752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230671e37c8e4c12b7892a8a65a2626a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.681786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230671e37c8e4c12b7892a8a65a2626a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.682559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230671e37c8e4c12b7892a8a65a2626a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.683275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230671e37c8e4c12b7892a8a65a2626a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.696983 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230671e37c8e4c12b7892a8a65a2626a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.729013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1233/2454] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:31 2022] DELETE /identity/v3/users/230671e37c8e4c12b7892a8a65a2626a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:31.734810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3d71b-c47d-4bf4-adcd-6778d33017c0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:31.735966 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3d71b-c47d-4bf4-adcd-6778d33017c0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:31.736520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3d71b-c47d-4bf4-adcd-6778d33017c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:31.762626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a4f3d71b-c47d-4bf4-adcd-6778d33017c0 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:31.764295 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a4f3d71b-c47d-4bf4-adcd-6778d33017c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:31.872406 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1222/2455] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:31.883011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:31.887417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:31.961536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c272-bc61-4541-8eed-77a8de6228df admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:31.965534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e3c9-cae4-433d-aa00-aa079e9b91bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:31.966300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e3c9-cae4-433d-aa00-aa079e9b91bc service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:31.966647 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e3c9-cae4-433d-aa00-aa079e9b91bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:31.966925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07e3c9-cae4-433d-aa00-aa079e9b91bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:31.977210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07e3c9-cae4-433d-aa00-aa079e9b91bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:31.979064 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07e3c9-cae4-433d-aa00-aa079e9b91bc service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:31.989206 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1234/2456] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:32.399659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3d71b-c47d-4bf4-adcd-6778d33017c0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:32.401563 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a4f3d71b-c47d-4bf4-adcd-6778d33017c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:32.415476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3d71b-c47d-4bf4-adcd-6778d33017c0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:32.421861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:32.423352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:32.423352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:32.423677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] PATH_INFO: `/v3/projects/4e333355b2e9472589dc56feafe1c7d2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:32.425280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e333355b2e9472589dc56feafe1c7d2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:32.427381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:32.475812 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:32.490110 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e333355b2e9472589dc56feafe1c7d2', 'request_id': 'req-56fc8d28-3d65-4068-b7ad-0a30bae968f5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.500088 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e333355b2e9472589dc56feafe1c7d2', 'request_id': 'req-56fc8d28-3d65-4068-b7ad-0a30bae968f5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.509906 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e333355b2e9472589dc56feafe1c7d2', 'request_id': 'req-56fc8d28-3d65-4068-b7ad-0a30bae968f5'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.522984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] The token cache is being invalidate because project 4e333355b2e9472589dc56feafe1c7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:32.523217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.523872 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.525730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1223/2457] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:32 2022] DELETE /identity/v3/projects/4e333355b2e9472589dc56feafe1c7d2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:32.533418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e3c9-cae4-433d-aa00-aa079e9b91bc service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:32.547679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07e3c9-cae4-433d-aa00-aa079e9b91bc service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:32.566735 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:32.641179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:32.642077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:32.642345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:32.642609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] PATH_INFO: `/v3/users/f603dadf387d4f42bf42edfc0628e672` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:32.643922 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f603dadf387d4f42bf42edfc0628e672)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:32.645880 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:32.711266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f603dadf387d4f42bf42edfc0628e672'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.723954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f603dadf387d4f42bf42edfc0628e672'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.724847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f603dadf387d4f42bf42edfc0628e672'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.726009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f603dadf387d4f42bf42edfc0628e672'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.735136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f603dadf387d4f42bf42edfc0628e672'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:32.751945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1235/2458] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:32 2022] DELETE /identity/v3/users/f603dadf387d4f42bf42edfc0628e672 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:33.152709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:33.155569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:33.189443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8d28-3d65-4068-b7ad-0a30bae968f5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:33.277423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:33.278631 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:33.278995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:33.279517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] PATH_INFO: `/v3/projects/3d09230312ea40b89ec0c6c56c27d38c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:33.280771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d09230312ea40b89ec0c6c56c27d38c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:33.282802 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:33.363962 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d09230312ea40b89ec0c6c56c27d38c', 'request_id': 'req-15d0a197-7443-43ec-bb5a-e10f95daf45a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.373951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d09230312ea40b89ec0c6c56c27d38c', 'request_id': 'req-15d0a197-7443-43ec-bb5a-e10f95daf45a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.382179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d09230312ea40b89ec0c6c56c27d38c', 'request_id': 'req-15d0a197-7443-43ec-bb5a-e10f95daf45a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.399123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] The token cache is being invalidate because project 3d09230312ea40b89ec0c6c56c27d38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:33.399451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.400139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.402003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1224/2459] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:33 2022] DELETE /identity/v3/projects/3d09230312ea40b89ec0c6c56c27d38c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:33.407400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:33.412673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:33.445066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b04afe-a75a-4dc0-9d38-67d5046df31a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:33.572404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:33.575957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:33.576789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:33.577520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] PATH_INFO: `/v3/users/e508b6cfe5364d16aa7975616a1c35e3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:33.580307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e508b6cfe5364d16aa7975616a1c35e3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:33.584307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:33.656006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:33.675943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e508b6cfe5364d16aa7975616a1c35e3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.694413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e508b6cfe5364d16aa7975616a1c35e3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.695281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e508b6cfe5364d16aa7975616a1c35e3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.695976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e508b6cfe5364d16aa7975616a1c35e3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.706098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-3bd92d50-41e7-4bb0-8187-e277e1b5a899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e508b6cfe5364d16aa7975616a1c35e3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:33.742317 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1236/2460] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:33 2022] DELETE /identity/v3/users/e508b6cfe5364d16aa7975616a1c35e3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:34.116793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:34.118768 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:34.148159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0a197-7443-43ec-bb5a-e10f95daf45a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:34.221766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:34.241074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:34.242904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.243671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.244489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] PATH_INFO: `/v3/projects/97b3a302becb4b1e8381b3a2c87fcf1f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.246140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b3a302becb4b1e8381b3a2c87fcf1f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:34.248448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:34.334629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b3a302becb4b1e8381b3a2c87fcf1f', 'request_id': 'req-bb76a2d1-a2ff-4da2-b536-52a28986eaae'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.365216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b3a302becb4b1e8381b3a2c87fcf1f', 'request_id': 'req-bb76a2d1-a2ff-4da2-b536-52a28986eaae'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.380030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b3a302becb4b1e8381b3a2c87fcf1f', 'request_id': 'req-bb76a2d1-a2ff-4da2-b536-52a28986eaae'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.397228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] The token cache is being invalidate because project 97b3a302becb4b1e8381b3a2c87fcf1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:34.397558 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.398296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-bb76a2d1-a2ff-4da2-b536-52a28986eaae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.399842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1225/2461] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:34 2022] DELETE /identity/v3/projects/97b3a302becb4b1e8381b3a2c87fcf1f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:34.405592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef459-cf8e-4de4-bcb1-2771d40d4dfb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.405592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef459-cf8e-4de4-bcb1-2771d40d4dfb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.406312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef459-cf8e-4de4-bcb1-2771d40d4dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.428752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7f2ef459-cf8e-4de4-bcb1-2771d40d4dfb None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:34.430219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7f2ef459-cf8e-4de4-bcb1-2771d40d4dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:34.539939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1237/2462] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:34.552171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3639b-157c-4cee-b77f-fc573881ce69 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.552545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3639b-157c-4cee-b77f-fc573881ce69 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.553512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3639b-157c-4cee-b77f-fc573881ce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.578380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-87b3639b-157c-4cee-b77f-fc573881ce69 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:34.580523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-87b3639b-157c-4cee-b77f-fc573881ce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:34.593839 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1226/2463] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:34.599361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef459-cf8e-4de4-bcb1-2771d40d4dfb None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:34.615410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef459-cf8e-4de4-bcb1-2771d40d4dfb None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:34.623105 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:34.624267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.624760 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.625511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.626725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:34.627415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:34.631552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:34.651001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1238/2464] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:34.657826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3639b-157c-4cee-b77f-fc573881ce69 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:34.673983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3639b-157c-4cee-b77f-fc573881ce69 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:34.680789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879859e-7fc6-48c9-bd90-0f27859da2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:34.681855 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879859e-7fc6-48c9-bd90-0f27859da2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.682213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879859e-7fc6-48c9-bd90-0f27859da2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.682575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879859e-7fc6-48c9-bd90-0f27859da2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.683417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879859e-7fc6-48c9-bd90-0f27859da2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:34.685427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879859e-7fc6-48c9-bd90-0f27859da2a8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:34.723213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1227/2465] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:34 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:34.728502 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:34.754997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d95b4d-e0eb-4351-92a8-f4c068f51abb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:34.846241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ee8b-1074-47c7-a76f-f563ac68069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:34.846949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ee8b-1074-47c7-a76f-f563ac68069a admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.847261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ee8b-1074-47c7-a76f-f563ac68069a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.847580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ee8b-1074-47c7-a76f-f563ac68069a admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.848273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ee8b-1074-47c7-a76f-f563ac68069a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:34.850320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ee8b-1074-47c7-a76f-f563ac68069a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:34.882497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1239/2466] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:34 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:34.886865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879859e-7fc6-48c9-bd90-0f27859da2a8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:34.906121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879859e-7fc6-48c9-bd90-0f27859da2a8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:34.912532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cc48-402e-45f3-a234-7ed375a83b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:34.913237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cc48-402e-45f3-a234-7ed375a83b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.913518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cc48-402e-45f3-a234-7ed375a83b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.913792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cc48-402e-45f3-a234-7ed375a83b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.914536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cc48-402e-45f3-a234-7ed375a83b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:34.916258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cc48-402e-45f3-a234-7ed375a83b05 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:34.931718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1228/2467] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:30:34.937767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ee8b-1074-47c7-a76f-f563ac68069a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:34.958023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ee8b-1074-47c7-a76f-f563ac68069a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:34.963823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec3f01-b521-4d44-a894-aa9398bb5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:34.964818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3f01-b521-4d44-a894-aa9398bb5be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.965351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3f01-b521-4d44-a894-aa9398bb5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.965778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec3f01-b521-4d44-a894-aa9398bb5be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.967011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec3f01-b521-4d44-a894-aa9398bb5be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:34.969586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec3f01-b521-4d44-a894-aa9398bb5be9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:34.983870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1240/2468] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:34.989339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cc48-402e-45f3-a234-7ed375a83b05 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:35.005223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cc48-402e-45f3-a234-7ed375a83b05 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:35.010656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:35.012227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.012781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.013393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] PATH_INFO: `/v3/projects/0d4f2598c4fa42c0a13faed31c864437/users/21103747675d4c41aae85aa3cd510310/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.036852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4f2598c4fa42c0a13faed31c864437, user_id=21103747675d4c41aae85aa3cd510310, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:35.039858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:35.061259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1229/2469] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:34 2022] PUT /identity/v3/projects/0d4f2598c4fa42c0a13faed31c864437/users/21103747675d4c41aae85aa3cd510310/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:35.076417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632059-3dd0-473d-9aca-3fd2e9e1fe8d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.076778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632059-3dd0-473d-9aca-3fd2e9e1fe8d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.077110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632059-3dd0-473d-9aca-3fd2e9e1fe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.114712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-06632059-3dd0-473d-9aca-3fd2e9e1fe8d None None] MFA Rules not processed for user `21103747675d4c41aae85aa3cd510310`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:35.115999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-06632059-3dd0-473d-9aca-3fd2e9e1fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:35.126446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:35.202199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1241/2470] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:35.214055 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:35.216032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:35.296862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca5f69-4296-4f77-a588-f1c04e21ee2d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:35.302430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a792a-a426-429d-98e4-ff0d877ca664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:35.303245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a792a-a426-429d-98e4-ff0d877ca664 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.303624 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a792a-a426-429d-98e4-ff0d877ca664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.303947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a792a-a426-429d-98e4-ff0d877ca664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.315233 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a792a-a426-429d-98e4-ff0d877ca664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:35.317015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a792a-a426-429d-98e4-ff0d877ca664 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:35.327119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1230/2471] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:45.198236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=23 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:45.322562 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:46.736321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06632059-3dd0-473d-9aca-3fd2e9e1fe8d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:46.816926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06632059-3dd0-473d-9aca-3fd2e9e1fe8d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:46.823476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:46.824613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:46.824921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:46.824921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] PATH_INFO: `/v3/users/21103747675d4c41aae85aa3cd510310` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:46.826233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21103747675d4c41aae85aa3cd510310)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:46.828252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:46.897161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21103747675d4c41aae85aa3cd510310'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:46.912816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21103747675d4c41aae85aa3cd510310'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:46.917514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21103747675d4c41aae85aa3cd510310'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:46.918239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21103747675d4c41aae85aa3cd510310'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:46.931610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21103747675d4c41aae85aa3cd510310'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:46.952946 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1242/2472] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:46 2022] DELETE /identity/v3/users/21103747675d4c41aae85aa3cd510310 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:46.955999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22117-7e23-4193-8c93-013a079d5ced None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:46.956662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22117-7e23-4193-8c93-013a079d5ced None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:46.957153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22117-7e23-4193-8c93-013a079d5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:46.980647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a8c22117-7e23-4193-8c93-013a079d5ced None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:46.981828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a8c22117-7e23-4193-8c93-013a079d5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:47.056559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1231/2473] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:47.073684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:47.076286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:47.167318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8f7bd-3d9f-4c18-8607-b6876e04025f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:47.174378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:47.175480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:47.175820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:47.176149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:47.188905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:47.192319 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:47.211374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1243/2474] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:47.586331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c22117-7e23-4193-8c93-013a079d5ced None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:47.588723 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a8c22117-7e23-4193-8c93-013a079d5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:47.641936 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c22117-7e23-4193-8c93-013a079d5ced None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:47.652621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:47.654120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:47.655349 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:47.656026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] PATH_INFO: `/v3/projects/0d4f2598c4fa42c0a13faed31c864437` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:47.658335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4f2598c4fa42c0a13faed31c864437)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:47.661786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:47.740074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4f2598c4fa42c0a13faed31c864437', 'request_id': 'req-e303c194-ecd5-41a9-988e-9dc9b4c69192'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:47.751775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4f2598c4fa42c0a13faed31c864437', 'request_id': 'req-e303c194-ecd5-41a9-988e-9dc9b4c69192'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:47.759585 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4f2598c4fa42c0a13faed31c864437', 'request_id': 'req-e303c194-ecd5-41a9-988e-9dc9b4c69192'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:47.778182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] The token cache is being invalidate because project 0d4f2598c4fa42c0a13faed31c864437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:47.778471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:47.779805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e303c194-ecd5-41a9-988e-9dc9b4c69192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:47.782596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1232/2475] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:47 2022] DELETE /identity/v3/projects/0d4f2598c4fa42c0a13faed31c864437 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:57.202771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:57.772897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:58.508622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:58.510492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:58.527704 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d3918-26f8-4bc6-b65a-7fdcb2495e6f service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:58.599975 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:58.600908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:58.601244 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:58.601609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] PATH_INFO: `/v3/users/a19d383a844742f0a67eb0fd08741f65` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:58.602919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19d383a844742f0a67eb0fd08741f65)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:58.605085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:58.677921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19d383a844742f0a67eb0fd08741f65'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:58.702857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19d383a844742f0a67eb0fd08741f65'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:58.704292 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19d383a844742f0a67eb0fd08741f65'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:58.705110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19d383a844742f0a67eb0fd08741f65'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:58.719214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19d383a844742f0a67eb0fd08741f65'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:58.734611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1244/2476] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:58 2022] DELETE /identity/v3/users/a19d383a844742f0a67eb0fd08741f65 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:58.740531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fde5c-3689-40c1-9897-b275ca523515 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:58.741130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fde5c-3689-40c1-9897-b275ca523515 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:58.741602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fde5c-3689-40c1-9897-b275ca523515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:58.767343 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7c6fde5c-3689-40c1-9897-b275ca523515 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:58.769418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7c6fde5c-3689-40c1-9897-b275ca523515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:58.858239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1233/2477] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:58.872696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:58.874882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:58.978936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4670-7bc2-4187-be3e-59b28a350d15 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:58.984095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:58.984824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:58.985166 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:58.985427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:58.999581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:59.001884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:59.018316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1245/2478] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:59.420618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fde5c-3689-40c1-9897-b275ca523515 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:59.425114 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7c6fde5c-3689-40c1-9897-b275ca523515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:59.448336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fde5c-3689-40c1-9897-b275ca523515 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:59.463391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:59.464437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:59.464779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:59.465031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] PATH_INFO: `/v3/projects/ed31e777d89549ccba82aba7d3871f09` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:59.466646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed31e777d89549ccba82aba7d3871f09)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:59.468784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:59.576097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed31e777d89549ccba82aba7d3871f09', 'request_id': 'req-781fb845-9ab9-4503-8e8b-86ae87533867'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.598923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed31e777d89549ccba82aba7d3871f09', 'request_id': 'req-781fb845-9ab9-4503-8e8b-86ae87533867'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.607169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed31e777d89549ccba82aba7d3871f09', 'request_id': 'req-781fb845-9ab9-4503-8e8b-86ae87533867'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.630417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] The token cache is being invalidate because project ed31e777d89549ccba82aba7d3871f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:59.630885 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.632033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-781fb845-9ab9-4503-8e8b-86ae87533867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.635392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1234/2479] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:59 2022] DELETE /identity/v3/projects/ed31e777d89549ccba82aba7d3871f09 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:03.996117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:03.998673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:04.020526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408113d-6bba-4313-a4d7-e6617761176f service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:04.043847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:04.103889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:04.104811 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:04.105247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:04.105523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] PATH_INFO: `/v3/users/0aea7e7855644a74a69323337815a272` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:04.107043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aea7e7855644a74a69323337815a272)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:04.109016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:04.177956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aea7e7855644a74a69323337815a272'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.198945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aea7e7855644a74a69323337815a272'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.200147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aea7e7855644a74a69323337815a272'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.201137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aea7e7855644a74a69323337815a272'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.212867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aea7e7855644a74a69323337815a272'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.230807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1246/2480] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:03 2022] DELETE /identity/v3/users/0aea7e7855644a74a69323337815a272 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:04.237628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8beda-bba2-408e-bd4b-929f375f500a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:04.238386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8beda-bba2-408e-bd4b-929f375f500a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:04.238538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8beda-bba2-408e-bd4b-929f375f500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:04.260456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6be8beda-bba2-408e-bd4b-929f375f500a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:04.261787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6be8beda-bba2-408e-bd4b-929f375f500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:04.345414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1235/2481] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:04.359506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:04.361254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:04.439542 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816e2b-4c51-4daf-a16e-ce924ec11a55 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:04.444616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e199b80-cdd9-48e2-9a0d-48d8b99f2e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:04.445522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e199b80-cdd9-48e2-9a0d-48d8b99f2e27 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:04.445981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e199b80-cdd9-48e2-9a0d-48d8b99f2e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:04.446437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e199b80-cdd9-48e2-9a0d-48d8b99f2e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:04.463101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e199b80-cdd9-48e2-9a0d-48d8b99f2e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:04.465496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e199b80-cdd9-48e2-9a0d-48d8b99f2e27 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:04.481036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1247/2482] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:04.847701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8beda-bba2-408e-bd4b-929f375f500a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:04.850326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6be8beda-bba2-408e-bd4b-929f375f500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:04.868391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8beda-bba2-408e-bd4b-929f375f500a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:04.873882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:04.874852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:04.875226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:04.875691 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] PATH_INFO: `/v3/projects/ac2153d1c1ee455d9029647ee282a328` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:04.878042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2153d1c1ee455d9029647ee282a328)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:04.882136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:04.915736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:04.958317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2153d1c1ee455d9029647ee282a328', 'request_id': 'req-1728530f-9ee3-4378-a91f-a18e29654fb8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.975858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2153d1c1ee455d9029647ee282a328', 'request_id': 'req-1728530f-9ee3-4378-a91f-a18e29654fb8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.984000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2153d1c1ee455d9029647ee282a328', 'request_id': 'req-1728530f-9ee3-4378-a91f-a18e29654fb8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.996143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] The token cache is being invalidate because project ac2153d1c1ee455d9029647ee282a328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:04.996353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.997418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1728530f-9ee3-4378-a91f-a18e29654fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:04.999141 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1236/2483] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:04 2022] DELETE /identity/v3/projects/ac2153d1c1ee455d9029647ee282a328 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:05.006696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4819-7ede-4006-adc1-e06f01fa59b3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.007377 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4819-7ede-4006-adc1-e06f01fa59b3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.008124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4819-7ede-4006-adc1-e06f01fa59b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.036857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9bdd4819-7ede-4006-adc1-e06f01fa59b3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:05.038895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9bdd4819-7ede-4006-adc1-e06f01fa59b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:05.116773 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:05.148661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1248/2484] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:05.161467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7ec6-33d6-465a-b163-1b2c01a48f2a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.164453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7ec6-33d6-465a-b163-1b2c01a48f2a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.165043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7ec6-33d6-465a-b163-1b2c01a48f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.195221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d6da7ec6-33d6-465a-b163-1b2c01a48f2a None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:05.197083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d6da7ec6-33d6-465a-b163-1b2c01a48f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:05.207345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1237/2485] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:05.215191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4819-7ede-4006-adc1-e06f01fa59b3 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.231963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4819-7ede-4006-adc1-e06f01fa59b3 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.240497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.241501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.241878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.242202 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.242724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:05.243116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.244707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.263618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1249/2486] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:31:05.264185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da7ec6-33d6-465a-b163-1b2c01a48f2a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.280610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da7ec6-33d6-465a-b163-1b2c01a48f2a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.290540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4392-1eba-43b7-bda8-da5de9c7a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.291754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4392-1eba-43b7-bda8-da5de9c7a0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.292232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4392-1eba-43b7-bda8-da5de9c7a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.292953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4392-1eba-43b7-bda8-da5de9c7a0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.294203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b4392-1eba-43b7-bda8-da5de9c7a0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.298097 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b4392-1eba-43b7-bda8-da5de9c7a0a1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.345243 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1238/2487] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:05 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:05.350421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.367480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8a0b-db5e-4310-8bbc-6552a236e842 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.460569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd956c-9a4a-4fd1-8846-e1932cde1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.461884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd956c-9a4a-4fd1-8846-e1932cde1e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.462451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd956c-9a4a-4fd1-8846-e1932cde1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.462799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd956c-9a4a-4fd1-8846-e1932cde1e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.463625 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd956c-9a4a-4fd1-8846-e1932cde1e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.465758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd956c-9a4a-4fd1-8846-e1932cde1e3e admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.491088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1250/2488] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:05 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:05.495393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4392-1eba-43b7-bda8-da5de9c7a0a1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.511280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4392-1eba-43b7-bda8-da5de9c7a0a1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.518052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b32fa-8c80-41db-a245-82ebc55b4371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.518876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b32fa-8c80-41db-a245-82ebc55b4371 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.519316 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b32fa-8c80-41db-a245-82ebc55b4371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.519702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b32fa-8c80-41db-a245-82ebc55b4371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.520778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b32fa-8c80-41db-a245-82ebc55b4371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.523274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b32fa-8c80-41db-a245-82ebc55b4371 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.536791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1239/2489] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:05.541311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd956c-9a4a-4fd1-8846-e1932cde1e3e admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.551659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd956c-9a4a-4fd1-8846-e1932cde1e3e admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.556443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53af838-bab8-4a9d-bd76-bb3741790ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.557118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af838-bab8-4a9d-bd76-bb3741790ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.557393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af838-bab8-4a9d-bd76-bb3741790ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.557661 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af838-bab8-4a9d-bd76-bb3741790ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.558437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53af838-bab8-4a9d-bd76-bb3741790ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.560178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53af838-bab8-4a9d-bd76-bb3741790ab9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.571847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1251/2490] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:05.576833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b32fa-8c80-41db-a245-82ebc55b4371 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.589355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b32fa-8c80-41db-a245-82ebc55b4371 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.594677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57b8f-80c9-4305-a6b4-dc8bfd24c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.595653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57b8f-80c9-4305-a6b4-dc8bfd24c563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.595937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57b8f-80c9-4305-a6b4-dc8bfd24c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.596234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57b8f-80c9-4305-a6b4-dc8bfd24c563 admin admin] PATH_INFO: `/v3/projects/ff40b971e6394ecaaf38ad3697c8688b/users/fdd8fb26c3a149d787c8a45318fff1b1/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.623574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f57b8f-80c9-4305-a6b4-dc8bfd24c563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff40b971e6394ecaaf38ad3697c8688b, user_id=fdd8fb26c3a149d787c8a45318fff1b1, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.626671 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f57b8f-80c9-4305-a6b4-dc8bfd24c563 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.641307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1240/2491] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:05 2022] PUT /identity/v3/projects/ff40b971e6394ecaaf38ad3697c8688b/users/fdd8fb26c3a149d787c8a45318fff1b1/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:05.652316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396592-6225-4d28-96a0-d9fcf62f2200 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.652610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396592-6225-4d28-96a0-d9fcf62f2200 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.653161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396592-6225-4d28-96a0-d9fcf62f2200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.709990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d2396592-6225-4d28-96a0-d9fcf62f2200 None None] MFA Rules not processed for user `fdd8fb26c3a149d787c8a45318fff1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:05.713724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d2396592-6225-4d28-96a0-d9fcf62f2200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:05.820457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1252/2492] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:05.828266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57b8f-80c9-4305-a6b4-dc8bfd24c563 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.925924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57b8f-80c9-4305-a6b4-dc8bfd24c563 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.934186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86194f-a6d8-4002-8934-1699be1f4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.935372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86194f-a6d8-4002-8934-1699be1f4d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.935696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86194f-a6d8-4002-8934-1699be1f4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.936024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86194f-a6d8-4002-8934-1699be1f4d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.936778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86194f-a6d8-4002-8934-1699be1f4d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.938786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86194f-a6d8-4002-8934-1699be1f4d85 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.969769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1241/2493] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:05 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:05.975219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2396592-6225-4d28-96a0-d9fcf62f2200 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.991495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2396592-6225-4d28-96a0-d9fcf62f2200 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.047370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:06.083730 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44395e-8feb-4b6c-99c3-837f1a42f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.084695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44395e-8feb-4b6c-99c3-837f1a42f4af admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.084976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44395e-8feb-4b6c-99c3-837f1a42f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.085629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44395e-8feb-4b6c-99c3-837f1a42f4af admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.086702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44395e-8feb-4b6c-99c3-837f1a42f4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.090153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44395e-8feb-4b6c-99c3-837f1a42f4af admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.119699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1253/2494] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:05 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:06.122219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86194f-a6d8-4002-8934-1699be1f4d85 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.137036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86194f-a6d8-4002-8934-1699be1f4d85 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.143095 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537059a-92e8-4eb9-bc5a-fe062fbf21cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.143817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537059a-92e8-4eb9-bc5a-fe062fbf21cf admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.144143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537059a-92e8-4eb9-bc5a-fe062fbf21cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.144414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537059a-92e8-4eb9-bc5a-fe062fbf21cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.145083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537059a-92e8-4eb9-bc5a-fe062fbf21cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.146714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537059a-92e8-4eb9-bc5a-fe062fbf21cf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.164298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1242/2495] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:06.168864 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44395e-8feb-4b6c-99c3-837f1a42f4af admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.184351 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44395e-8feb-4b6c-99c3-837f1a42f4af admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.189476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef95bc2-8e2e-48f9-a522-3df753c5a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.190231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95bc2-8e2e-48f9-a522-3df753c5a732 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.190518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95bc2-8e2e-48f9-a522-3df753c5a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.190796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95bc2-8e2e-48f9-a522-3df753c5a732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.191607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef95bc2-8e2e-48f9-a522-3df753c5a732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.193340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef95bc2-8e2e-48f9-a522-3df753c5a732 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.210947 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1254/2496] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:06.220808 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537059a-92e8-4eb9-bc5a-fe062fbf21cf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.252203 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537059a-92e8-4eb9-bc5a-fe062fbf21cf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.268967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecb7ea-1a7c-457e-a9ba-81ffa0d3655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.268967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecb7ea-1a7c-457e-a9ba-81ffa0d3655f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.270323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecb7ea-1a7c-457e-a9ba-81ffa0d3655f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.270323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecb7ea-1a7c-457e-a9ba-81ffa0d3655f admin admin] PATH_INFO: `/v3/projects/e240c3cbe98f4b6aba5c6610a16f504c/users/8aea92f8fca540c9b39427fc7168c3e2/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.308653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecb7ea-1a7c-457e-a9ba-81ffa0d3655f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e240c3cbe98f4b6aba5c6610a16f504c, user_id=8aea92f8fca540c9b39427fc7168c3e2, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.314918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecb7ea-1a7c-457e-a9ba-81ffa0d3655f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.319242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:06.338534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1243/2497] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:06 2022] PUT /identity/v3/projects/e240c3cbe98f4b6aba5c6610a16f504c/users/8aea92f8fca540c9b39427fc7168c3e2/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:06.354171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57c144-df02-470d-b4f6-8d50e6fade0a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.354637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57c144-df02-470d-b4f6-8d50e6fade0a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.355151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57c144-df02-470d-b4f6-8d50e6fade0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.410240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-db57c144-df02-470d-b4f6-8d50e6fade0a None None] MFA Rules not processed for user `8aea92f8fca540c9b39427fc7168c3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:06.412903 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-db57c144-df02-470d-b4f6-8d50e6fade0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:06.510370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1255/2498] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:06.516425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecb7ea-1a7c-457e-a9ba-81ffa0d3655f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.590153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecb7ea-1a7c-457e-a9ba-81ffa0d3655f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.599986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cda5c0-008c-4c8e-a4f0-aaaedbcb0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.600785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cda5c0-008c-4c8e-a4f0-aaaedbcb0232 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.601092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cda5c0-008c-4c8e-a4f0-aaaedbcb0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.601540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cda5c0-008c-4c8e-a4f0-aaaedbcb0232 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.602307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cda5c0-008c-4c8e-a4f0-aaaedbcb0232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.604601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cda5c0-008c-4c8e-a4f0-aaaedbcb0232 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.651019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1244/2499] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:06 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:06.656102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57c144-df02-470d-b4f6-8d50e6fade0a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.673957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57c144-df02-470d-b4f6-8d50e6fade0a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.762700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee014-51ab-4d5c-87a6-0453581af8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.763555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee014-51ab-4d5c-87a6-0453581af8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.763858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee014-51ab-4d5c-87a6-0453581af8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.764149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee014-51ab-4d5c-87a6-0453581af8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.764907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eee014-51ab-4d5c-87a6-0453581af8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.767020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eee014-51ab-4d5c-87a6-0453581af8c1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.790713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1256/2500] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:06 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:06.795557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cda5c0-008c-4c8e-a4f0-aaaedbcb0232 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.807374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cda5c0-008c-4c8e-a4f0-aaaedbcb0232 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.813052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e039b1e-b791-4460-a080-a00eb170e7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.813830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e039b1e-b791-4460-a080-a00eb170e7de admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.814118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e039b1e-b791-4460-a080-a00eb170e7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.814394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e039b1e-b791-4460-a080-a00eb170e7de admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.815213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e039b1e-b791-4460-a080-a00eb170e7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.816929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e039b1e-b791-4460-a080-a00eb170e7de admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.829945 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1245/2501] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:06.834904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee014-51ab-4d5c-87a6-0453581af8c1 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.847032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee014-51ab-4d5c-87a6-0453581af8c1 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.852929 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd0333-3b94-4adc-9f99-d96ce1cc599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.854025 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0333-3b94-4adc-9f99-d96ce1cc599d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.854450 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0333-3b94-4adc-9f99-d96ce1cc599d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.854866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0333-3b94-4adc-9f99-d96ce1cc599d admin admin] PATH_INFO: `/v3/projects/e92589dd24ec4606b17a6a006ba9763c/users/5f3061776c4845be83f0f57bba81917e/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.878018 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0333-3b94-4adc-9f99-d96ce1cc599d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92589dd24ec4606b17a6a006ba9763c, user_id=5f3061776c4845be83f0f57bba81917e, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.881970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0333-3b94-4adc-9f99-d96ce1cc599d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.906499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1257/2502] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:06 2022] PUT /identity/v3/projects/e92589dd24ec4606b17a6a006ba9763c/users/5f3061776c4845be83f0f57bba81917e/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:06.911231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e039b1e-b791-4460-a080-a00eb170e7de admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.920870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c98f-164c-40d6-ac5b-86eb18730a70 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.921093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c98f-164c-40d6-ac5b-86eb18730a70 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.921557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c98f-164c-40d6-ac5b-86eb18730a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.927648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e039b1e-b791-4460-a080-a00eb170e7de admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.957254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7846c98f-164c-40d6-ac5b-86eb18730a70 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:06.960008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7846c98f-164c-40d6-ac5b-86eb18730a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:06.975764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:07.037422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b921ad-19d4-4f0b-b58c-50ca434d540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:07.038277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b921ad-19d4-4f0b-b58c-50ca434d540b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:07.038684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b921ad-19d4-4f0b-b58c-50ca434d540b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:07.039769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b921ad-19d4-4f0b-b58c-50ca434d540b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:07.039975 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b921ad-19d4-4f0b-b58c-50ca434d540b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:07.041586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b921ad-19d4-4f0b-b58c-50ca434d540b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:07.052922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1246/2503] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:07.054853 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1258/2504] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:07.057139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b921ad-19d4-4f0b-b58c-50ca434d540b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:07.068684 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b921ad-19d4-4f0b-b58c-50ca434d540b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:07.073928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:07.075725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:07.075725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:07.075725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] PATH_INFO: `/v3/projects/e92589dd24ec4606b17a6a006ba9763c/users/5f3061776c4845be83f0f57bba81917e/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:07.077683 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92589dd24ec4606b17a6a006ba9763c, user_id=5f3061776c4845be83f0f57bba81917e, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:07.080507 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:07.093741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1247/2505] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:07 2022] PUT /identity/v3/projects/e92589dd24ec4606b17a6a006ba9763c/users/5f3061776c4845be83f0f57bba81917e/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:07.105673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519f99-9046-4247-870e-b94ff0058a8c None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:07.105984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519f99-9046-4247-870e-b94ff0058a8c None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:07.106352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519f99-9046-4247-870e-b94ff0058a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:07.142806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-5d519f99-9046-4247-870e-b94ff0058a8c None None] MFA Rules not processed for user `5f3061776c4845be83f0f57bba81917e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:07.144638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5d519f99-9046-4247-870e-b94ff0058a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:07.172159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:07.174707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:07.256035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:07.260871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1259/2506] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:07.278430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d519f99-9046-4247-870e-b94ff0058a8c None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:07.280686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5d519f99-9046-4247-870e-b94ff0058a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:07.285801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbae07-1fe4-46d5-96b4-339b58995aa9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:07.294105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:07.295212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:07.295662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:07.296076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:07.376342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:07.378086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:07.378237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d519f99-9046-4247-870e-b94ff0058a8c None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:07.384798 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c38e2-4b24-4119-b316-2099e1ff6cee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:07.385943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c38e2-4b24-4119-b316-2099e1ff6cee service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:07.386504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c38e2-4b24-4119-b316-2099e1ff6cee service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:07.387040 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c38e2-4b24-4119-b316-2099e1ff6cee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:07.392473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1248/2507] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:07.480012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:07.484074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c38e2-4b24-4119-b316-2099e1ff6cee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:07.485541 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c38e2-4b24-4119-b316-2099e1ff6cee service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:07.508804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1260/2508] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:09.167916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:09.170032 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:09.188473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3801fd-6c93-46af-ae1e-69a6987db37e service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:09.193901 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fa319-7dcf-4258-aa3a-7304d345b0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:09.194953 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa319-7dcf-4258-aa3a-7304d345b0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:09.196699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa319-7dcf-4258-aa3a-7304d345b0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:09.196699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa319-7dcf-4258-aa3a-7304d345b0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:09.278366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fa319-7dcf-4258-aa3a-7304d345b0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:09.281326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fa319-7dcf-4258-aa3a-7304d345b0c5 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:09.298400 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1249/2509] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:10.107578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c38e2-4b24-4119-b316-2099e1ff6cee service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:10.121558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c38e2-4b24-4119-b316-2099e1ff6cee service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:10.129430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:10.130777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:10.131357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:10.131904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:10.150386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:10.153408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:10.170242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1261/2510] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:12.393776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557001f-e698-42eb-9e1c-27262f02be39 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:12.394351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557001f-e698-42eb-9e1c-27262f02be39 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:12.394725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557001f-e698-42eb-9e1c-27262f02be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:12.414078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7557001f-e698-42eb-9e1c-27262f02be39 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:12.415587 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7557001f-e698-42eb-9e1c-27262f02be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:12.429105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1250/2511] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:12.457005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:12.458636 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:12.476464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb2d4-3471-4ff2-81e2-be27e06cef34 service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:12.482985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e2bab-483c-47ec-85bb-b9564b04d93d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:12.483740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2bab-483c-47ec-85bb-b9564b04d93d service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:12.484060 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2bab-483c-47ec-85bb-b9564b04d93d service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:12.484399 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2bab-483c-47ec-85bb-b9564b04d93d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:12.494273 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e2bab-483c-47ec-85bb-b9564b04d93d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:12.497238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e2bab-483c-47ec-85bb-b9564b04d93d service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:12.507865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1262/2512] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:14.650807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557001f-e698-42eb-9e1c-27262f02be39 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:14.661511 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557001f-e698-42eb-9e1c-27262f02be39 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:14.668392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:14.669982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.670482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:14.671070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] PATH_INFO: `/v3/users/fdd8fb26c3a149d787c8a45318fff1b1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:14.672626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd8fb26c3a149d787c8a45318fff1b1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:14.675942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:14.736216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd8fb26c3a149d787c8a45318fff1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.751801 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd8fb26c3a149d787c8a45318fff1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.752596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd8fb26c3a149d787c8a45318fff1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.757819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:14.761240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd8fb26c3a149d787c8a45318fff1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.762748 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd8fb26c3a149d787c8a45318fff1b1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.782271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1251/2513] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:14 2022] DELETE /identity/v3/users/fdd8fb26c3a149d787c8a45318fff1b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:14.788728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063cf9-0753-43df-b333-0b8c5b50e6b3 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.789520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063cf9-0753-43df-b333-0b8c5b50e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:14.789520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063cf9-0753-43df-b333-0b8c5b50e6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:14.814543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c2063cf9-0753-43df-b333-0b8c5b50e6b3 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:14.816218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c2063cf9-0753-43df-b333-0b8c5b50e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:14.910354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1263/2514] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:14.921169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:14.922761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:14.994320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5893-022c-4da7-a085-c579c5872edd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:14.998884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:14.999628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.999970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.000395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.018942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.022212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.043253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1252/2515] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:15.430080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623f38-c769-4753-8c23-4e5f4a88a112 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.430544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623f38-c769-4753-8c23-4e5f4a88a112 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.430904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623f38-c769-4753-8c23-4e5f4a88a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.456196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8a623f38-c769-4753-8c23-4e5f4a88a112 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:15.457452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a623f38-c769-4753-8c23-4e5f4a88a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:15.467913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1264/2516] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:15.491340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.492898 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:15.580744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeb4d6-bc45-46f6-b503-8023b4874509 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.587937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.588637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.588927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.589308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.600980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.602648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.614345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1253/2517] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:15.636376 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623f38-c769-4753-8c23-4e5f4a88a112 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.638454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a623f38-c769-4753-8c23-4e5f4a88a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:15.668270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623f38-c769-4753-8c23-4e5f4a88a112 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.680463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.681581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.681961 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.682336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] PATH_INFO: `/v3/projects/ff40b971e6394ecaaf38ad3697c8688b` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.683886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff40b971e6394ecaaf38ad3697c8688b)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.686159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.720470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.724480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:15.750902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff40b971e6394ecaaf38ad3697c8688b', 'request_id': 'req-94134091-7948-4bdd-820c-e4f48d2cf981'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:15.769160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff40b971e6394ecaaf38ad3697c8688b', 'request_id': 'req-94134091-7948-4bdd-820c-e4f48d2cf981'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:15.782840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5b899-490c-42f8-9af9-49a31f0acd51 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.787874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff40b971e6394ecaaf38ad3697c8688b', 'request_id': 'req-94134091-7948-4bdd-820c-e4f48d2cf981'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:15.809197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] The token cache is being invalidate because project ff40b971e6394ecaaf38ad3697c8688b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:15.810258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:15.811270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:15.813460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1265/2518] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:15 2022] DELETE /identity/v3/projects/ff40b971e6394ecaaf38ad3697c8688b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:15.820660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.822904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:15.915452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:15.925375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.926561 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.926994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.927690 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] PATH_INFO: `/v3/users/d3d05ddacc2a44d180ecd766c03af3dc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.930083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d05ddacc2a44d180ecd766c03af3dc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.933050 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.959011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:15.962669 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94134091-7948-4bdd-820c-e4f48d2cf981 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.968095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.969092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.969369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.969644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] PATH_INFO: `/v3/users/8aea92f8fca540c9b39427fc7168c3e2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.971183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aea92f8fca540c9b39427fc7168c3e2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.973666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:16.029437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d05ddacc2a44d180ecd766c03af3dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.047773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d05ddacc2a44d180ecd766c03af3dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.048538 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d05ddacc2a44d180ecd766c03af3dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.049462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aea92f8fca540c9b39427fc7168c3e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.067954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aea92f8fca540c9b39427fc7168c3e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.069090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aea92f8fca540c9b39427fc7168c3e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.069384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d05ddacc2a44d180ecd766c03af3dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.069840 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aea92f8fca540c9b39427fc7168c3e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.070527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2047e153-2443-4ecd-96e7-0c299d581ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d05ddacc2a44d180ecd766c03af3dc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.079267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aea92f8fca540c9b39427fc7168c3e2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.091921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1254/2519] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:15 2022] DELETE /identity/v3/users/d3d05ddacc2a44d180ecd766c03af3dc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:16.098560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec757c-643c-4881-afa7-08aceda7b9f8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.098995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec757c-643c-4881-afa7-08aceda7b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.099278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec757c-643c-4881-afa7-08aceda7b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.103042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1266/2520] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:15 2022] DELETE /identity/v3/users/8aea92f8fca540c9b39427fc7168c3e2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:16.124636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-beec757c-643c-4881-afa7-08aceda7b9f8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:16.126125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-beec757c-643c-4881-afa7-08aceda7b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:16.213813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1255/2521] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:16.228754 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:16.233278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:16.342663 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f45cd8-5c90-46d7-a928-6ac6f0d7daeb admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:16.348862 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91639-7a4b-4be2-8423-a7b87715badb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:16.349912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91639-7a4b-4be2-8423-a7b87715badb service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.350482 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91639-7a4b-4be2-8423-a7b87715badb service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.351398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91639-7a4b-4be2-8423-a7b87715badb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.365349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed91639-7a4b-4be2-8423-a7b87715badb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:16.366836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed91639-7a4b-4be2-8423-a7b87715badb service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:16.378336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1267/2522] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:16.522687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec757c-643c-4881-afa7-08aceda7b9f8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:16.526764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-beec757c-643c-4881-afa7-08aceda7b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:16.559566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec757c-643c-4881-afa7-08aceda7b9f8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:16.567118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:16.568599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.568889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.569221 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] PATH_INFO: `/v3/projects/e240c3cbe98f4b6aba5c6610a16f504c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.571424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e240c3cbe98f4b6aba5c6610a16f504c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:16.574586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:16.634280 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e240c3cbe98f4b6aba5c6610a16f504c', 'request_id': 'req-1e1111b1-5450-46d0-9fa0-bdca9eb87061'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.644514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e240c3cbe98f4b6aba5c6610a16f504c', 'request_id': 'req-1e1111b1-5450-46d0-9fa0-bdca9eb87061'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.651929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e240c3cbe98f4b6aba5c6610a16f504c', 'request_id': 'req-1e1111b1-5450-46d0-9fa0-bdca9eb87061'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.674171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] The token cache is being invalidate because project e240c3cbe98f4b6aba5c6610a16f504c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:16.674551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.675313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.677006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1256/2523] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:16 2022] DELETE /identity/v3/projects/e240c3cbe98f4b6aba5c6610a16f504c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:16.681225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91639-7a4b-4be2-8423-a7b87715badb service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:16.692169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91639-7a4b-4be2-8423-a7b87715badb service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:16.785014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:16.785827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:16.786559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.786724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:16.787094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.787437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] PATH_INFO: `/v3/users/5f3061776c4845be83f0f57bba81917e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.789340 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3061776c4845be83f0f57bba81917e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:16.792100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:16.800672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1111b1-5450-46d0-9fa0-bdca9eb87061 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:16.802476 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:16.807309 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:16.808481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.808851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.809230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] PATH_INFO: `/v3/projects/b6f6366a30094c5d8ebf8b354135affe` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.810591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f6366a30094c5d8ebf8b354135affe)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:16.812718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:16.830188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:16.868784 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3061776c4845be83f0f57bba81917e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.877973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f6366a30094c5d8ebf8b354135affe', 'request_id': 'req-a805d087-26d2-4c44-8f30-367b7b827ddd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.885752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f6366a30094c5d8ebf8b354135affe', 'request_id': 'req-a805d087-26d2-4c44-8f30-367b7b827ddd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.886994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3061776c4845be83f0f57bba81917e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.888102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3061776c4845be83f0f57bba81917e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.888900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3061776c4845be83f0f57bba81917e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.895621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f6366a30094c5d8ebf8b354135affe', 'request_id': 'req-a805d087-26d2-4c44-8f30-367b7b827ddd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.912152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] The token cache is being invalidate because project b6f6366a30094c5d8ebf8b354135affe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:16.912422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.913487 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a805d087-26d2-4c44-8f30-367b7b827ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.914721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-f8c0d43a-5377-4725-b79a-e03f9ef4cbb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3061776c4845be83f0f57bba81917e'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.920645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1257/2524] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:16 2022] DELETE /identity/v3/projects/b6f6366a30094c5d8ebf8b354135affe => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:16.928057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ecca5-6692-4c20-a4a9-9d4e94b367f9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.928618 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ecca5-6692-4c20-a4a9-9d4e94b367f9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.928986 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ecca5-6692-4c20-a4a9-9d4e94b367f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.951827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1268/2525] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:16 2022] DELETE /identity/v3/users/5f3061776c4845be83f0f57bba81917e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:16.976465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-929ecca5-6692-4c20-a4a9-9d4e94b367f9 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:16.977743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-929ecca5-6692-4c20-a4a9-9d4e94b367f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.090681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1258/2526] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:17.093059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414d9a-6a0f-4df6-8d23-e834ede66665 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.093552 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414d9a-6a0f-4df6-8d23-e834ede66665 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.095048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28414d9a-6a0f-4df6-8d23-e834ede66665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.119122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-28414d9a-6a0f-4df6-8d23-e834ede66665 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:17.122820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-28414d9a-6a0f-4df6-8d23-e834ede66665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.140428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1269/2527] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:17.145528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ecca5-6692-4c20-a4a9-9d4e94b367f9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.156913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ecca5-6692-4c20-a4a9-9d4e94b367f9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.167227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.168455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.168927 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.169418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.170444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:17.171234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.173681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.201744 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1259/2528] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:31:17.207461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414d9a-6a0f-4df6-8d23-e834ede66665 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.222532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28414d9a-6a0f-4df6-8d23-e834ede66665 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.232386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.233467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.233916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.234363 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.235597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.239312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.291289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1270/2529] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:17.293241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.312228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7508820-5d2f-4ecb-b4db-473e5e4e96b9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.415366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7eee-7e28-47f1-81f4-8f4fa7567c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.416473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7eee-7e28-47f1-81f4-8f4fa7567c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.416836 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7eee-7e28-47f1-81f4-8f4fa7567c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.417648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7eee-7e28-47f1-81f4-8f4fa7567c33 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.419035 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf7eee-7e28-47f1-81f4-8f4fa7567c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.421741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf7eee-7e28-47f1-81f4-8f4fa7567c33 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.445454 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.448891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.455330 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1260/2530] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:17.466639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7eee-7e28-47f1-81f4-8f4fa7567c33 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.472370 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e01ec-1685-4f85-bcf0-6fff61006de5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.483366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.486449 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.487339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.488012 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] PATH_INFO: `/v3/projects/e92589dd24ec4606b17a6a006ba9763c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.491275 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92589dd24ec4606b17a6a006ba9763c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.496181 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.511773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7eee-7e28-47f1-81f4-8f4fa7567c33 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.534659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed834f6-b0f7-462f-bb1d-192bad0b2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.535528 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed834f6-b0f7-462f-bb1d-192bad0b2ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.535989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed834f6-b0f7-462f-bb1d-192bad0b2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.536377 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed834f6-b0f7-462f-bb1d-192bad0b2ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.537572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed834f6-b0f7-462f-bb1d-192bad0b2ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.538995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed834f6-b0f7-462f-bb1d-192bad0b2ee2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.551015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1261/2531] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:17.555788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed834f6-b0f7-462f-bb1d-192bad0b2ee2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.570025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed834f6-b0f7-462f-bb1d-192bad0b2ee2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.575454 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:17.592075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92589dd24ec4606b17a6a006ba9763c', 'request_id': 'req-b203e642-2be6-4f9a-851d-918d12fa6040'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.604087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92589dd24ec4606b17a6a006ba9763c', 'request_id': 'req-b203e642-2be6-4f9a-851d-918d12fa6040'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.616357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92589dd24ec4606b17a6a006ba9763c', 'request_id': 'req-b203e642-2be6-4f9a-851d-918d12fa6040'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.639121 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] The token cache is being invalidate because project e92589dd24ec4606b17a6a006ba9763c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:17.639716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.640640 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b203e642-2be6-4f9a-851d-918d12fa6040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.646753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1271/2532] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:17 2022] DELETE /identity/v3/projects/e92589dd24ec4606b17a6a006ba9763c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:17.649568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94dd5e-a144-4427-ae83-bb3860f2c0c7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.650071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94dd5e-a144-4427-ae83-bb3860f2c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.650519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94dd5e-a144-4427-ae83-bb3860f2c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.662860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.663652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.664010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.664284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.665024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.666729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.678457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1262/2533] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:17.681203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-fe94dd5e-a144-4427-ae83-bb3860f2c0c7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:17.682753 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe94dd5e-a144-4427-ae83-bb3860f2c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.683640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.685376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.703968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1272/2534] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:17.705816 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc1e0-e073-4e6e-9ede-5cf7712e5029 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.706175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc1e0-e073-4e6e-9ede-5cf7712e5029 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.706460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc1e0-e073-4e6e-9ede-5cf7712e5029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.710499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65161-37a1-4d05-8f8b-5f30df066cf0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.719981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a84cf-59cc-4357-8e92-a8e1ae8cb7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.720899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a84cf-59cc-4357-8e92-a8e1ae8cb7c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.721180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a84cf-59cc-4357-8e92-a8e1ae8cb7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.721451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a84cf-59cc-4357-8e92-a8e1ae8cb7c6 admin admin] PATH_INFO: `/v3/projects/23b3aaaea8964ee79976fc3fffd54c8c/users/0cc1fa22af0240058e5d6f21380ec1de/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.730977 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-afefc1e0-e073-4e6e-9ede-5cf7712e5029 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:17.732736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-afefc1e0-e073-4e6e-9ede-5cf7712e5029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.740335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a84cf-59cc-4357-8e92-a8e1ae8cb7c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b3aaaea8964ee79976fc3fffd54c8c, user_id=0cc1fa22af0240058e5d6f21380ec1de, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.748063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1273/2535] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:17.748256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a84cf-59cc-4357-8e92-a8e1ae8cb7c6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.749523 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefc1e0-e073-4e6e-9ede-5cf7712e5029 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.765993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefc1e0-e073-4e6e-9ede-5cf7712e5029 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.771586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1263/2536] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:17 2022] PUT /identity/v3/projects/23b3aaaea8964ee79976fc3fffd54c8c/users/0cc1fa22af0240058e5d6f21380ec1de/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:17.788865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51d9d-e3fb-4a98-9502-c635e708e013 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.789594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51d9d-e3fb-4a98-9502-c635e708e013 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.789594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51d9d-e3fb-4a98-9502-c635e708e013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.804117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:17.823419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ddc51d9d-e3fb-4a98-9502-c635e708e013 None None] MFA Rules not processed for user `0cc1fa22af0240058e5d6f21380ec1de`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:17.824783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ddc51d9d-e3fb-4a98-9502-c635e708e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.874061 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.874833 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.875163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.875517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.876230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:17.876539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.878189 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.895963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1274/2537] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:31:17.902226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.913646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af0508-05f8-4fff-b7c3-e96fdfc4ef71 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.918879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d9896-18dd-4a9b-8f10-d1f997450bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.919501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d9896-18dd-4a9b-8f10-d1f997450bff admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.919793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d9896-18dd-4a9b-8f10-d1f997450bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.920051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d9896-18dd-4a9b-8f10-d1f997450bff admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.920755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d9896-18dd-4a9b-8f10-d1f997450bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.922721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d9896-18dd-4a9b-8f10-d1f997450bff admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.923761 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1264/2538] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:17.939346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc51d9d-e3fb-4a98-9502-c635e708e013 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.941236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ddc51d9d-e3fb-4a98-9502-c635e708e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.964666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1275/2539] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:17.969432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d9896-18dd-4a9b-8f10-d1f997450bff admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.024054 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc51d9d-e3fb-4a98-9502-c635e708e013 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.046249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d9896-18dd-4a9b-8f10-d1f997450bff admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.051967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:18.052269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0abf0-80d7-4ffb-b049-2e6d6feab671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.052958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0abf0-80d7-4ffb-b049-2e6d6feab671 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.053285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0abf0-80d7-4ffb-b049-2e6d6feab671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.053560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0abf0-80d7-4ffb-b049-2e6d6feab671 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.054364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0abf0-80d7-4ffb-b049-2e6d6feab671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.056550 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0abf0-80d7-4ffb-b049-2e6d6feab671 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.080081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1276/2540] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:18.084793 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0abf0-80d7-4ffb-b049-2e6d6feab671 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.097960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374d68-ff21-4b68-a9f1-ae8fcfd3ba52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.098193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0abf0-80d7-4ffb-b049-2e6d6feab671 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.099121 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374d68-ff21-4b68-a9f1-ae8fcfd3ba52 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.099548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374d68-ff21-4b68-a9f1-ae8fcfd3ba52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.099937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374d68-ff21-4b68-a9f1-ae8fcfd3ba52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.105307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680445e1-4f5b-47aa-b227-dbeeb2e72c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.106330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680445e1-4f5b-47aa-b227-dbeeb2e72c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.106766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680445e1-4f5b-47aa-b227-dbeeb2e72c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.107178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680445e1-4f5b-47aa-b227-dbeeb2e72c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.108365 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680445e1-4f5b-47aa-b227-dbeeb2e72c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.111102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680445e1-4f5b-47aa-b227-dbeeb2e72c71 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.127710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1277/2541] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:18.133907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680445e1-4f5b-47aa-b227-dbeeb2e72c71 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.148650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680445e1-4f5b-47aa-b227-dbeeb2e72c71 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.157524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2919b-932c-4063-aa12-abea9e6c8ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.158515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2919b-932c-4063-aa12-abea9e6c8ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.158980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2919b-932c-4063-aa12-abea9e6c8ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.159518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2919b-932c-4063-aa12-abea9e6c8ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.160780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2919b-932c-4063-aa12-abea9e6c8ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.163768 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2919b-932c-4063-aa12-abea9e6c8ba0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.174835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374d68-ff21-4b68-a9f1-ae8fcfd3ba52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.176902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374d68-ff21-4b68-a9f1-ae8fcfd3ba52 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.178584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1278/2542] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:18.184703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2919b-932c-4063-aa12-abea9e6c8ba0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.193270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1265/2543] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:18.198581 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2919b-932c-4063-aa12-abea9e6c8ba0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.206219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80f90-b17b-4035-bfdd-3a7d0b967100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.207368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80f90-b17b-4035-bfdd-3a7d0b967100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.207660 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80f90-b17b-4035-bfdd-3a7d0b967100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.208051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80f90-b17b-4035-bfdd-3a7d0b967100 admin admin] PATH_INFO: `/v3/projects/9ada0f02487f4a57b8c22cd4df121454/users/f37d306bfd094baa98efc92d706bb4fc/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.233030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80f90-b17b-4035-bfdd-3a7d0b967100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ada0f02487f4a57b8c22cd4df121454, user_id=f37d306bfd094baa98efc92d706bb4fc, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.241110 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80f90-b17b-4035-bfdd-3a7d0b967100 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.273513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1279/2544] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:18 2022] PUT /identity/v3/projects/9ada0f02487f4a57b8c22cd4df121454/users/f37d306bfd094baa98efc92d706bb4fc/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:18.290650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec708dc-3c03-44ab-87ab-a2c3c289c279 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.292645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec708dc-3c03-44ab-87ab-a2c3c289c279 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.293239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec708dc-3c03-44ab-87ab-a2c3c289c279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.327817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4ec708dc-3c03-44ab-87ab-a2c3c289c279 None None] MFA Rules not processed for user `f37d306bfd094baa98efc92d706bb4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:18.329540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ec708dc-3c03-44ab-87ab-a2c3c289c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:18.438070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1266/2545] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:18.480027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80f90-b17b-4035-bfdd-3a7d0b967100 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.536754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85a1e2-e3f1-4d86-9a8c-ba60b8c4d76e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.537516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85a1e2-e3f1-4d86-9a8c-ba60b8c4d76e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.537955 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85a1e2-e3f1-4d86-9a8c-ba60b8c4d76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.564489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:18.582490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5e85a1e2-e3f1-4d86-9a8c-ba60b8c4d76e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:18.583800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5e85a1e2-e3f1-4d86-9a8c-ba60b8c4d76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:18.592788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80f90-b17b-4035-bfdd-3a7d0b967100 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.599977 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.601151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.601624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.602094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.620820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.624078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.642362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1280/2546] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:18.715197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1267/2547] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:18.766849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.768810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:18.903981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f20469-661f-4400-ace6-2749add690bf service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.919570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02673dac-fd5a-4810-91ab-3b3e164517ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.920501 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02673dac-fd5a-4810-91ab-3b3e164517ad service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.920999 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02673dac-fd5a-4810-91ab-3b3e164517ad service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.921264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02673dac-fd5a-4810-91ab-3b3e164517ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.934357 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02673dac-fd5a-4810-91ab-3b3e164517ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.936243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02673dac-fd5a-4810-91ab-3b3e164517ad service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.950771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1281/2548] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:21.524810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85a1e2-e3f1-4d86-9a8c-ba60b8c4d76e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:21.536657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85a1e2-e3f1-4d86-9a8c-ba60b8c4d76e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:21.544112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:21.545674 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:21.546178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:21.546639 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] PATH_INFO: `/v3/users/f37d306bfd094baa98efc92d706bb4fc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:21.548604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37d306bfd094baa98efc92d706bb4fc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:21.551718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:21.564718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:21.633800 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37d306bfd094baa98efc92d706bb4fc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.683786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37d306bfd094baa98efc92d706bb4fc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.685122 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37d306bfd094baa98efc92d706bb4fc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.703989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37d306bfd094baa98efc92d706bb4fc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.705613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37d306bfd094baa98efc92d706bb4fc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.732961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1268/2549] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:21 2022] DELETE /identity/v3/users/f37d306bfd094baa98efc92d706bb4fc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:21.739555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4f725-933c-4273-86f5-479816043892 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:21.740119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4f725-933c-4273-86f5-479816043892 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:21.740119 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4f725-933c-4273-86f5-479816043892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:21.765430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8ac4f725-933c-4273-86f5-479816043892 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:21.766827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8ac4f725-933c-4273-86f5-479816043892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:21.859967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1282/2550] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:21.869729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:21.871236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:21.948283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e692c6-f31b-4347-8298-656d8ee91a46 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:21.952479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4457e-f1e1-474b-bcd2-b90f8eac57d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:21.953169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4457e-f1e1-474b-bcd2-b90f8eac57d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:21.953451 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4457e-f1e1-474b-bcd2-b90f8eac57d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:21.953727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4457e-f1e1-474b-bcd2-b90f8eac57d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:21.967917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4457e-f1e1-474b-bcd2-b90f8eac57d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:21.970600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4457e-f1e1-474b-bcd2-b90f8eac57d9 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:21.982409 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1269/2551] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:22.392360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4f725-933c-4273-86f5-479816043892 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:22.394960 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8ac4f725-933c-4273-86f5-479816043892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:22.427559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4f725-933c-4273-86f5-479816043892 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:22.441468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:22.442694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:22.443002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:22.443656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] PATH_INFO: `/v3/projects/9ada0f02487f4a57b8c22cd4df121454` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:22.446001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ada0f02487f4a57b8c22cd4df121454)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:22.448905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:22.520458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ada0f02487f4a57b8c22cd4df121454', 'request_id': 'req-5319924e-8140-48e1-b123-1a94c4105d1a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.529735 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ada0f02487f4a57b8c22cd4df121454', 'request_id': 'req-5319924e-8140-48e1-b123-1a94c4105d1a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.540282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ada0f02487f4a57b8c22cd4df121454', 'request_id': 'req-5319924e-8140-48e1-b123-1a94c4105d1a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.541805 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:22.560733 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] The token cache is being invalidate because project 9ada0f02487f4a57b8c22cd4df121454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:22.561034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.561726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.564032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1283/2552] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:22 2022] DELETE /identity/v3/projects/9ada0f02487f4a57b8c22cd4df121454 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:22.992056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012bc5-e53e-48c1-b032-f52c4b85ebe6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:22.992610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012bc5-e53e-48c1-b032-f52c4b85ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:22.993065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012bc5-e53e-48c1-b032-f52c4b85ebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.018679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-58012bc5-e53e-48c1-b032-f52c4b85ebe6 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:23.020111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-58012bc5-e53e-48c1-b032-f52c4b85ebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:23.109353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1270/2553] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:23.133939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:23.136200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:23.254284 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319924e-8140-48e1-b123-1a94c4105d1a admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:23.263664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e46b58-a92e-42ec-a100-5da7c8181d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:23.264431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e46b58-a92e-42ec-a100-5da7c8181d70 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.264779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e46b58-a92e-42ec-a100-5da7c8181d70 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.265154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e46b58-a92e-42ec-a100-5da7c8181d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.275227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e46b58-a92e-42ec-a100-5da7c8181d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:23.277106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e46b58-a92e-42ec-a100-5da7c8181d70 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:23.288204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1284/2554] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:28.298779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366762a-3240-4a8b-befa-1ff64ee9ad00 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:28.299602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366762a-3240-4a8b-befa-1ff64ee9ad00 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:28.300201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366762a-3240-4a8b-befa-1ff64ee9ad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:28.335118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f366762a-3240-4a8b-befa-1ff64ee9ad00 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:28.337299 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f366762a-3240-4a8b-befa-1ff64ee9ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:28.355038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1271/2555] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:28.394813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e46b58-a92e-42ec-a100-5da7c8181d70 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:28.408781 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e46b58-a92e-42ec-a100-5da7c8181d70 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:28.417962 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819d8ea-1109-4aaa-ba3b-01519cbef97f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:28.418814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819d8ea-1109-4aaa-ba3b-01519cbef97f service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:28.419227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819d8ea-1109-4aaa-ba3b-01519cbef97f service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:28.419870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819d8ea-1109-4aaa-ba3b-01519cbef97f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:28.432639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819d8ea-1109-4aaa-ba3b-01519cbef97f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:28.434828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819d8ea-1109-4aaa-ba3b-01519cbef97f service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:28.464034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1285/2556] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:28.898787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366762a-3240-4a8b-befa-1ff64ee9ad00 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:28.900539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f366762a-3240-4a8b-befa-1ff64ee9ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:28.913525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366762a-3240-4a8b-befa-1ff64ee9ad00 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:28.919499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:28.920418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:28.920709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:28.920984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] PATH_INFO: `/v3/users/0cc1fa22af0240058e5d6f21380ec1de` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:28.922297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc1fa22af0240058e5d6f21380ec1de)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:28.924413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:28.942635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:28.999448 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc1fa22af0240058e5d6f21380ec1de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.016846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc1fa22af0240058e5d6f21380ec1de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.018752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc1fa22af0240058e5d6f21380ec1de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.029027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc1fa22af0240058e5d6f21380ec1de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.030116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc1fa22af0240058e5d6f21380ec1de'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.049908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1272/2557] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:28 2022] DELETE /identity/v3/users/0cc1fa22af0240058e5d6f21380ec1de => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:29.055857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b219e-2e11-4ed4-9a5f-24fa78a5e385 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:29.056144 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b219e-2e11-4ed4-9a5f-24fa78a5e385 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:29.056426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b219e-2e11-4ed4-9a5f-24fa78a5e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:29.083241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-728b219e-2e11-4ed4-9a5f-24fa78a5e385 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:29.085213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-728b219e-2e11-4ed4-9a5f-24fa78a5e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:29.175404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1286/2558] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:29.188264 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:29.189704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:29.300751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866f05b-3634-48ec-aee2-bb0c0a20ca36 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:29.306714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a9b7-baec-4e4d-bed3-1d2dd1f53db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:29.308422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a9b7-baec-4e4d-bed3-1d2dd1f53db8 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:29.310296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a9b7-baec-4e4d-bed3-1d2dd1f53db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:29.311329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a9b7-baec-4e4d-bed3-1d2dd1f53db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:29.335854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a9b7-baec-4e4d-bed3-1d2dd1f53db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:29.338356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a9b7-baec-4e4d-bed3-1d2dd1f53db8 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:29.355081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1273/2559] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:29.792767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b219e-2e11-4ed4-9a5f-24fa78a5e385 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:29.794285 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-728b219e-2e11-4ed4-9a5f-24fa78a5e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:29.825928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b219e-2e11-4ed4-9a5f-24fa78a5e385 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:29.835545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:29.836976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:29.837431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:29.837716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] PATH_INFO: `/v3/projects/23b3aaaea8964ee79976fc3fffd54c8c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:29.839787 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b3aaaea8964ee79976fc3fffd54c8c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:29.842398 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:29.881520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706c38-8130-41c2-ad0e-dddb19faad63 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:29.881964 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706c38-8130-41c2-ad0e-dddb19faad63 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:29.882433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706c38-8130-41c2-ad0e-dddb19faad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:29.905223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b3aaaea8964ee79976fc3fffd54c8c', 'request_id': 'req-50f59489-2025-40f9-b0cd-e47f74aea38a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.907021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-34706c38-8130-41c2-ad0e-dddb19faad63 None None] MFA Rules not processed for user `f8a9929565fe44d680a0b2f7d8065b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:29.908788 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-34706c38-8130-41c2-ad0e-dddb19faad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:29.914322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b3aaaea8964ee79976fc3fffd54c8c', 'request_id': 'req-50f59489-2025-40f9-b0cd-e47f74aea38a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.921083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:29.927210 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b3aaaea8964ee79976fc3fffd54c8c', 'request_id': 'req-50f59489-2025-40f9-b0cd-e47f74aea38a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.964782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] The token cache is being invalidate because project 23b3aaaea8964ee79976fc3fffd54c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:29.966394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.968331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-50f59489-2025-40f9-b0cd-e47f74aea38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.970400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1287/2560] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:29 2022] DELETE /identity/v3/projects/23b3aaaea8964ee79976fc3fffd54c8c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:29.976952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d7835-4f1f-4ebe-916a-4c8dcd47f435 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:29.977345 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d7835-4f1f-4ebe-916a-4c8dcd47f435 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:29.977694 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d7835-4f1f-4ebe-916a-4c8dcd47f435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:29.990194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1274/2561] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:30.002035 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-974d7835-4f1f-4ebe-916a-4c8dcd47f435 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:30.003455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-974d7835-4f1f-4ebe-916a-4c8dcd47f435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:30.107409 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1288/2562] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:30.109963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1a2e-2961-4498-9fc8-7dd5cc7d68a7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.110326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1a2e-2961-4498-9fc8-7dd5cc7d68a7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.110647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1a2e-2961-4498-9fc8-7dd5cc7d68a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.136006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bb1c1a2e-2961-4498-9fc8-7dd5cc7d68a7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:30.137311 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bb1c1a2e-2961-4498-9fc8-7dd5cc7d68a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:30.146947 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1275/2563] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:30.151526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d7835-4f1f-4ebe-916a-4c8dcd47f435 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.168887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d7835-4f1f-4ebe-916a-4c8dcd47f435 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.174085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.174849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.175223 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.175582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.176496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:30.176752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.178473 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.194286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1289/2564] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:31:30.200764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c1a2e-2961-4498-9fc8-7dd5cc7d68a7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.213654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c1a2e-2961-4498-9fc8-7dd5cc7d68a7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.219519 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ef5f-1c97-4311-9189-ea23b031591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.220210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ef5f-1c97-4311-9189-ea23b031591d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.220493 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ef5f-1c97-4311-9189-ea23b031591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.220771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ef5f-1c97-4311-9189-ea23b031591d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.221496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449ef5f-1c97-4311-9189-ea23b031591d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.223478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449ef5f-1c97-4311-9189-ea23b031591d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.256043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1276/2565] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:30 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:30.260431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.271109 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf8fb9-bbcc-4342-8593-15106065dbba admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.358989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d75ea-aa90-4848-a449-4ce4ff9b9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.359632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d75ea-aa90-4848-a449-4ce4ff9b9c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.359909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d75ea-aa90-4848-a449-4ce4ff9b9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.360222 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d75ea-aa90-4848-a449-4ce4ff9b9c09 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.360909 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d75ea-aa90-4848-a449-4ce4ff9b9c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.363460 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d75ea-aa90-4848-a449-4ce4ff9b9c09 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.393122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1290/2566] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:30 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:30.398516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ef5f-1c97-4311-9189-ea23b031591d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.410322 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ef5f-1c97-4311-9189-ea23b031591d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.416180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687957e-3d4c-4529-a214-8764b27b64e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.417183 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687957e-3d4c-4529-a214-8764b27b64e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.417600 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687957e-3d4c-4529-a214-8764b27b64e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.417985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687957e-3d4c-4529-a214-8764b27b64e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.418882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687957e-3d4c-4529-a214-8764b27b64e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.420993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687957e-3d4c-4529-a214-8764b27b64e9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.424200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:30.435466 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1277/2567] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:30.441247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d75ea-aa90-4848-a449-4ce4ff9b9c09 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.452893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d75ea-aa90-4848-a449-4ce4ff9b9c09 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.457751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1d2a1-973f-4d98-a72f-6bbbf2edc47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.458444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1d2a1-973f-4d98-a72f-6bbbf2edc47b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.458722 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1d2a1-973f-4d98-a72f-6bbbf2edc47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.459026 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1d2a1-973f-4d98-a72f-6bbbf2edc47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.459765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1d2a1-973f-4d98-a72f-6bbbf2edc47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.461487 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1d2a1-973f-4d98-a72f-6bbbf2edc47b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.487028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1291/2568] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:30.488279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687957e-3d4c-4529-a214-8764b27b64e9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.502875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687957e-3d4c-4529-a214-8764b27b64e9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.509517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.510880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.511414 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.511875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] PATH_INFO: `/v3/projects/ff831dd38308489fbcec5e161337f44e/users/3a1da964b16b4b0b92d84274cb973553/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.541213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff831dd38308489fbcec5e161337f44e, user_id=3a1da964b16b4b0b92d84274cb973553, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.546123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.566499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1278/2569] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:30 2022] PUT /identity/v3/projects/ff831dd38308489fbcec5e161337f44e/users/3a1da964b16b4b0b92d84274cb973553/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:30.573865 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9cdbf-569b-4025-b42a-3b7ee75bf275 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.574387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9cdbf-569b-4025-b42a-3b7ee75bf275 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.574898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9cdbf-569b-4025-b42a-3b7ee75bf275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.599447 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-baa9cdbf-569b-4025-b42a-3b7ee75bf275 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:30.600584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-baa9cdbf-569b-4025-b42a-3b7ee75bf275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:30.698677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:30.728789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1292/2570] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:30.742797 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.748491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:30.849752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305eb9a-88c3-4647-aa49-512b8dae68d6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.854325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabb46a-710b-47e6-9ea1-d1330d3741e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.855217 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabb46a-710b-47e6-9ea1-d1330d3741e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.855510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabb46a-710b-47e6-9ea1-d1330d3741e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.855791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabb46a-710b-47e6-9ea1-d1330d3741e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.869613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabb46a-710b-47e6-9ea1-d1330d3741e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.872660 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabb46a-710b-47e6-9ea1-d1330d3741e0 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.890255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1279/2571] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:36.916142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555028-9b3d-457d-8cea-97cea5f04048 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:36.916769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555028-9b3d-457d-8cea-97cea5f04048 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:36.916769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555028-9b3d-457d-8cea-97cea5f04048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:36.965720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a5555028-9b3d-457d-8cea-97cea5f04048 None None] MFA Rules not processed for user `3a1da964b16b4b0b92d84274cb973553`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:36.967631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a5555028-9b3d-457d-8cea-97cea5f04048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:37.055755 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1293/2572] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:37.059880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabb46a-710b-47e6-9ea1-d1330d3741e0 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:37.075459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabb46a-710b-47e6-9ea1-d1330d3741e0 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:37.082652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f8559-2f74-49d6-9da3-92a6c79f3eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:37.083550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8559-2f74-49d6-9da3-92a6c79f3eba admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:37.083932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8559-2f74-49d6-9da3-92a6c79f3eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:37.084305 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8559-2f74-49d6-9da3-92a6c79f3eba admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:37.085137 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8559-2f74-49d6-9da3-92a6c79f3eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:37.087318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8559-2f74-49d6-9da3-92a6c79f3eba admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:37.127016 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1280/2573] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:37 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:37.131570 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5555028-9b3d-457d-8cea-97cea5f04048 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:37.144103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5555028-9b3d-457d-8cea-97cea5f04048 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:37.250691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f40c82-00da-417f-8346-797530f0e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:37.251560 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40c82-00da-417f-8346-797530f0e9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:37.252004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40c82-00da-417f-8346-797530f0e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:37.252307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f40c82-00da-417f-8346-797530f0e9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:37.253022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f40c82-00da-417f-8346-797530f0e9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:37.255360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f40c82-00da-417f-8346-797530f0e9d6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:37.283268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1294/2574] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:37 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:37.289418 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f8559-2f74-49d6-9da3-92a6c79f3eba admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:37.307081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f8559-2f74-49d6-9da3-92a6c79f3eba admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:37.313331 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fedba4-dd8a-4b8e-88b5-ff9b0eed24c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:37.314006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fedba4-dd8a-4b8e-88b5-ff9b0eed24c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:37.314364 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fedba4-dd8a-4b8e-88b5-ff9b0eed24c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:37.314611 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fedba4-dd8a-4b8e-88b5-ff9b0eed24c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:37.315515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fedba4-dd8a-4b8e-88b5-ff9b0eed24c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:37.317357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fedba4-dd8a-4b8e-88b5-ff9b0eed24c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:37.333878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1281/2575] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:37.339075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f40c82-00da-417f-8346-797530f0e9d6 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:37.393027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f40c82-00da-417f-8346-797530f0e9d6 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:37.413086 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29842-2754-4cba-b317-cec4f8ead8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:37.414648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29842-2754-4cba-b317-cec4f8ead8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:37.415246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29842-2754-4cba-b317-cec4f8ead8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:37.415743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29842-2754-4cba-b317-cec4f8ead8cd admin admin] PATH_INFO: `/v3/projects/0208366b33bb4c9db636c6f68d2fb5b3/users/747d6343930b4beea1a46b156bcbaa3f/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:37.452866 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d29842-2754-4cba-b317-cec4f8ead8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0208366b33bb4c9db636c6f68d2fb5b3, user_id=747d6343930b4beea1a46b156bcbaa3f, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:37.459929 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d29842-2754-4cba-b317-cec4f8ead8cd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:37.475427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1295/2576] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:37 2022] PUT /identity/v3/projects/0208366b33bb4c9db636c6f68d2fb5b3/users/747d6343930b4beea1a46b156bcbaa3f/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:37.480987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fedba4-dd8a-4b8e-88b5-ff9b0eed24c9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:37.494552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fedba4-dd8a-4b8e-88b5-ff9b0eed24c9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:37.581206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:37.581919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:37.582207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:37.582483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:37.583294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:37.585194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:37.598589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1282/2577] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:37.604675 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29842-2754-4cba-b317-cec4f8ead8cd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:37.621448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29842-2754-4cba-b317-cec4f8ead8cd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:37.628118 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9efd-4146-476a-b087-21f273424cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:37.629465 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9efd-4146-476a-b087-21f273424cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:37.629759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9efd-4146-476a-b087-21f273424cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:37.630130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9efd-4146-476a-b087-21f273424cbb admin admin] PATH_INFO: `/v3/projects/0208366b33bb4c9db636c6f68d2fb5b3/users/747d6343930b4beea1a46b156bcbaa3f/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:37.634374 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9efd-4146-476a-b087-21f273424cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0208366b33bb4c9db636c6f68d2fb5b3, user_id=747d6343930b4beea1a46b156bcbaa3f, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:37.640195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9efd-4146-476a-b087-21f273424cbb admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:37.660282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1296/2578] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:37 2022] PUT /identity/v3/projects/0208366b33bb4c9db636c6f68d2fb5b3/users/747d6343930b4beea1a46b156bcbaa3f/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:40.486682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:40.489214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:40.601694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:40.682285 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3e83-7c76-4e78-8ac9-7e40b243eae7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:40.811650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:40.812758 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:40.813034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:40.813308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:40.815422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:40.832112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:40.834810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:40.849354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1283/2579] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:45.537276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1d47-5ed4-4cca-80c9-f617a341d3f2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:45.537276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1d47-5ed4-4cca-80c9-f617a341d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:45.537276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1d47-5ed4-4cca-80c9-f617a341d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:45.586063 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-896e1d47-5ed4-4cca-80c9-f617a341d3f2 None None] MFA Rules not processed for user `747d6343930b4beea1a46b156bcbaa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:45.588350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-896e1d47-5ed4-4cca-80c9-f617a341d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:45.639441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:45.721469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1297/2580] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:45.736117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:45.738235 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:45.859187 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1583-1394-4442-af4f-47e531fb52d8 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:45.871218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47beb14-54c5-42ad-9e92-b8174085e725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:45.871897 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47beb14-54c5-42ad-9e92-b8174085e725 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:45.872707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47beb14-54c5-42ad-9e92-b8174085e725 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:45.873103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47beb14-54c5-42ad-9e92-b8174085e725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:45.969662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47beb14-54c5-42ad-9e92-b8174085e725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:45.971430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47beb14-54c5-42ad-9e92-b8174085e725 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:45.982154 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1284/2581] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:47.449062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b8e7-bb76-4bb6-8927-cad8a14f631f None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:47.458518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b8e7-bb76-4bb6-8927-cad8a14f631f None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:47.458518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b8e7-bb76-4bb6-8927-cad8a14f631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:47.474749 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b9f9b8e7-bb76-4bb6-8927-cad8a14f631f None None] MFA Rules not processed for user `3a1da964b16b4b0b92d84274cb973553`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:47.476089 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9f9b8e7-bb76-4bb6-8927-cad8a14f631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:47.484141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1298/2582] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:48.098086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b415a-b332-4f8a-85c5-8972906f1f2d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:48.098599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b415a-b332-4f8a-85c5-8972906f1f2d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:48.098679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b415a-b332-4f8a-85c5-8972906f1f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:48.118458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fb6b415a-b332-4f8a-85c5-8972906f1f2d None None] MFA Rules not processed for user `091cd0c1f4fd40a1a362879e97e0966f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:48.119921 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fb6b415a-b332-4f8a-85c5-8972906f1f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:48.125165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:48.197405 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1285/2583] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:57.467287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=20 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:58.186036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=21 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:05.622893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d3d0-b331-4a94-93b2-6708d51efd72 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:05.624818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d3d0-b331-4a94-93b2-6708d51efd72 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:05.626322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d3d0-b331-4a94-93b2-6708d51efd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:05.690014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ebe8d3d0-b331-4a94-93b2-6708d51efd72 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:05.693600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ebe8d3d0-b331-4a94-93b2-6708d51efd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:05.793305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1299/2584] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:05.814852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b415a-b332-4f8a-85c5-8972906f1f2d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:05.816372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fb6b415a-b332-4f8a-85c5-8972906f1f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:05.834052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b415a-b332-4f8a-85c5-8972906f1f2d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:05.840488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b5db-b307-4743-9778-d56cc5b63759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:05.841372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b5db-b307-4743-9778-d56cc5b63759 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:05.841787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b5db-b307-4743-9778-d56cc5b63759 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:05.842168 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b5db-b307-4743-9778-d56cc5b63759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:05.854490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94b5db-b307-4743-9778-d56cc5b63759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:05.856883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94b5db-b307-4743-9778-d56cc5b63759 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:05.868005 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1286/2585] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:08.915429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2775273-163c-43cc-b516-d52df233160e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:08.915956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2775273-163c-43cc-b516-d52df233160e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:08.916055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2775273-163c-43cc-b516-d52df233160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:08.937776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-a2775273-163c-43cc-b516-d52df233160e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:08.939083 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-a2775273-163c-43cc-b516-d52df233160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:08.948471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1300/2586] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:08.969984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b5db-b307-4743-9778-d56cc5b63759 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:08.981396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b5db-b307-4743-9778-d56cc5b63759 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:08.987250 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fea52-bbcd-4c77-bab4-ab9d7cd481e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:08.987888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fea52-bbcd-4c77-bab4-ab9d7cd481e3 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:08.988166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fea52-bbcd-4c77-bab4-ab9d7cd481e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:08.988769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fea52-bbcd-4c77-bab4-ab9d7cd481e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:08.999237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fea52-bbcd-4c77-bab4-ab9d7cd481e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:09.000826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fea52-bbcd-4c77-bab4-ab9d7cd481e3 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:09.011726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1287/2587] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:13.013536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a380df-228d-4207-8d61-a8c04f0cb9ca None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:13.014141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a380df-228d-4207-8d61-a8c04f0cb9ca None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:13.014141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a380df-228d-4207-8d61-a8c04f0cb9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:13.037860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-77a380df-228d-4207-8d61-a8c04f0cb9ca None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:13.039213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-77a380df-228d-4207-8d61-a8c04f0cb9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:13.051615 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1301/2588] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:13.075603 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fea52-bbcd-4c77-bab4-ab9d7cd481e3 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:13.087344 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fea52-bbcd-4c77-bab4-ab9d7cd481e3 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:13.093173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bca3f-8331-457a-81a2-d7d2abca0468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:13.093818 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bca3f-8331-457a-81a2-d7d2abca0468 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:13.094093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bca3f-8331-457a-81a2-d7d2abca0468 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:13.094362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bca3f-8331-457a-81a2-d7d2abca0468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:13.105980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bca3f-8331-457a-81a2-d7d2abca0468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:13.105980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bca3f-8331-457a-81a2-d7d2abca0468 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:13.117012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1288/2589] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:18.271544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0497793-afab-4312-b4c8-2b569b4a36e4 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:18.272283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0497793-afab-4312-b4c8-2b569b4a36e4 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:18.272283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0497793-afab-4312-b4c8-2b569b4a36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:18.297362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d0497793-afab-4312-b4c8-2b569b4a36e4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:18.299332 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d0497793-afab-4312-b4c8-2b569b4a36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:18.311783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1302/2590] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:18.335594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bca3f-8331-457a-81a2-d7d2abca0468 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:18.351525 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bca3f-8331-457a-81a2-d7d2abca0468 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:18.357740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47655b4-cbff-4725-af9f-4b7e251cd85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:18.358491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47655b4-cbff-4725-af9f-4b7e251cd85f service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:18.358929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47655b4-cbff-4725-af9f-4b7e251cd85f service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:18.359297 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47655b4-cbff-4725-af9f-4b7e251cd85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:18.371736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47655b4-cbff-4725-af9f-4b7e251cd85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:18.373615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47655b4-cbff-4725-af9f-4b7e251cd85f service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:18.385641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1289/2591] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:19.314736 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0497793-afab-4312-b4c8-2b569b4a36e4 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:19.377808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0497793-afab-4312-b4c8-2b569b4a36e4 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:19.381809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b30ba-f398-4322-8793-153b61e4241f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:19.382444 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b30ba-f398-4322-8793-153b61e4241f service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:19.382719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b30ba-f398-4322-8793-153b61e4241f service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:19.382990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b30ba-f398-4322-8793-153b61e4241f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:19.398076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b30ba-f398-4322-8793-153b61e4241f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:19.400539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b30ba-f398-4322-8793-153b61e4241f service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:19.412043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1303/2592] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:21.465423 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4440-9d06-4463-a7b9-737c414190a9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:21.466062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4440-9d06-4463-a7b9-737c414190a9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:21.466062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4440-9d06-4463-a7b9-737c414190a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:21.490504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8619-1fec-4037-ab1b-103b1c505114 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:21.491149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8619-1fec-4037-ab1b-103b1c505114 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:21.491996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2b6a4440-9d06-4463-a7b9-737c414190a9 None None] MFA Rules not processed for user `4eca399e504a451e8925f13d3e156be3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:21.492350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8619-1fec-4037-ab1b-103b1c505114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:21.493978 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b6a4440-9d06-4463-a7b9-737c414190a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:21.528538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ac7e8619-1fec-4037-ab1b-103b1c505114 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:21.531700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ac7e8619-1fec-4037-ab1b-103b1c505114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:21.541506 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1304/2593] 10.222.0.98 () {58 vars in 1016 bytes} [Wed Jul 20 15:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:21.562695 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e8619-1fec-4037-ab1b-103b1c505114 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:21.602135 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1290/2594] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:32:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:21.605653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e8619-1fec-4037-ab1b-103b1c505114 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:21.617413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900376ba-407a-42f9-bdd3-e740e2d61457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:21.618240 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900376ba-407a-42f9-bdd3-e740e2d61457 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:21.618709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900376ba-407a-42f9-bdd3-e740e2d61457 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:21.619289 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900376ba-407a-42f9-bdd3-e740e2d61457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:21.635877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900376ba-407a-42f9-bdd3-e740e2d61457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:21.645590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900376ba-407a-42f9-bdd3-e740e2d61457 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:21.658808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1305/2595] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:31.584201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=49 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:31.650578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=71 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:51.950634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4440-9d06-4463-a7b9-737c414190a9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:51.956355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b6a4440-9d06-4463-a7b9-737c414190a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:51.973060 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4440-9d06-4463-a7b9-737c414190a9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:51.978530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:51.979494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:51.979835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:51.980094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] PATH_INFO: `/v3/users/091cd0c1f4fd40a1a362879e97e0966f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:51.981455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091cd0c1f4fd40a1a362879e97e0966f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:51.983648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:52.049881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091cd0c1f4fd40a1a362879e97e0966f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.067776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091cd0c1f4fd40a1a362879e97e0966f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.068583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091cd0c1f4fd40a1a362879e97e0966f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.076694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091cd0c1f4fd40a1a362879e97e0966f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.077327 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9b6c5673-7df6-419e-9d26-239f8ce10d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091cd0c1f4fd40a1a362879e97e0966f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.092625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1291/2596] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:32:51 2022] DELETE /identity/v3/users/091cd0c1f4fd40a1a362879e97e0966f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:52.304471 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900376ba-407a-42f9-bdd3-e740e2d61457 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:52.326342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900376ba-407a-42f9-bdd3-e740e2d61457 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:52.412281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:52.413183 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:52.413479 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:52.413777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] PATH_INFO: `/v3/projects/a56764b8ffae4441a74af5d9b3991bc8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:52.414981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56764b8ffae4441a74af5d9b3991bc8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:52.417058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:52.470211 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56764b8ffae4441a74af5d9b3991bc8', 'request_id': 'req-bb4889f3-2b1b-4866-9041-b954d37e6aff'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.482096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56764b8ffae4441a74af5d9b3991bc8', 'request_id': 'req-bb4889f3-2b1b-4866-9041-b954d37e6aff'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.488921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56764b8ffae4441a74af5d9b3991bc8', 'request_id': 'req-bb4889f3-2b1b-4866-9041-b954d37e6aff'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.504368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] The token cache is being invalidate because project a56764b8ffae4441a74af5d9b3991bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:32:52.504368 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.506122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:52.507307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1306/2597] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:32:52 2022] DELETE /identity/v3/projects/a56764b8ffae4441a74af5d9b3991bc8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:56.149046 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e4a4e-8954-46c6-a799-cd348bf1a330 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:56.149592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e4a4e-8954-46c6-a799-cd348bf1a330 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:56.149592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e4a4e-8954-46c6-a799-cd348bf1a330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:56.168350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-616e4a4e-8954-46c6-a799-cd348bf1a330 None None] MFA Rules not processed for user `f8a9929565fe44d680a0b2f7d8065b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:56.169569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-616e4a4e-8954-46c6-a799-cd348bf1a330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:56.230676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1292/2598] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:02.499715 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:06.222547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:32.528299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:32.530491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:32.617403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4889f3-2b1b-4866-9041-b954d37e6aff admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:32.623543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:32.624366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:32.624801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:32.625264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:32.628154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:32.734107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:32.735696 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:32.750386 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1307/2599] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:33:33.365040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e4a4e-8954-46c6-a799-cd348bf1a330 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:33.366797 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-616e4a4e-8954-46c6-a799-cd348bf1a330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:33.432799 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e4a4e-8954-46c6-a799-cd348bf1a330 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:33.436789 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:33.437457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:33.437732 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:33.438003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:33.439980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:33.455420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:33.456882 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:33.468859 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1293/2600] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:38.362272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:38.371778 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e588-5e13-43c0-b291-a8af7ff30fc4 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:38.375940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:38.376597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:38.376878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:38.377156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:38.379059 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:38.462079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:38.463586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:38.475034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1308/2601] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:42.700946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:42.702459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:42.716911 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797333-23a5-4834-8245-20544b123343 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:42.722000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:42.722890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:42.723200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:42.723503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] PATH_INFO: `/v3/users/4eca399e504a451e8925f13d3e156be3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:42.724678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eca399e504a451e8925f13d3e156be3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:42.726647 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:42.783567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eca399e504a451e8925f13d3e156be3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:42.796486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eca399e504a451e8925f13d3e156be3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:42.797210 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eca399e504a451e8925f13d3e156be3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:42.804260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eca399e504a451e8925f13d3e156be3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:42.804935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-47f41413-e627-4ec7-89a3-416926b4e476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eca399e504a451e8925f13d3e156be3'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:42.823083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1294/2602] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:42 2022] DELETE /identity/v3/users/4eca399e504a451e8925f13d3e156be3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:43.289592 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:43.303931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930a4f-9cd8-4d8d-849a-1cc096dc8470 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:43.341726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:43.368291 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:43.369169 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.369446 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.369711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] PATH_INFO: `/v3/projects/807e5b338e6e49b8bc16340edc14baa2` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.371101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807e5b338e6e49b8bc16340edc14baa2)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:43.373366 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:43.423113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807e5b338e6e49b8bc16340edc14baa2', 'request_id': 'req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:43.431994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807e5b338e6e49b8bc16340edc14baa2', 'request_id': 'req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:43.438049 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807e5b338e6e49b8bc16340edc14baa2', 'request_id': 'req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:43.449886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] The token cache is being invalidate because project 807e5b338e6e49b8bc16340edc14baa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:43.450178 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:43.450950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6e4f2cad-63b0-4120-9150-ec7d8e4d6336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:43.452673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1309/2603] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:43 2022] DELETE /identity/v3/projects/807e5b338e6e49b8bc16340edc14baa2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:43.457858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4744-f34f-4623-a685-9c10f9297c33 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.458384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4744-f34f-4623-a685-9c10f9297c33 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.458727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4744-f34f-4623-a685-9c10f9297c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.480275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7a2c4744-f34f-4623-a685-9c10f9297c33 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:43.481728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7a2c4744-f34f-4623-a685-9c10f9297c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:43.551175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1295/2604] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:43.560472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eec42-795d-4c09-a67b-7c07c0d4a7af None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.560767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eec42-795d-4c09-a67b-7c07c0d4a7af None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.561041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eec42-795d-4c09-a67b-7c07c0d4a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.582372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-800eec42-795d-4c09-a67b-7c07c0d4a7af None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:43.583659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-800eec42-795d-4c09-a67b-7c07c0d4a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:43.593561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1310/2605] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:43.598073 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4744-f34f-4623-a685-9c10f9297c33 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:43.610482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4744-f34f-4623-a685-9c10f9297c33 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:43.616849 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:43.617539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.617822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.618098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.618850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:33:43.619198 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:43.621446 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:43.635001 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1296/2606] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:33:43.639629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eec42-795d-4c09-a67b-7c07c0d4a7af None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:43.649648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eec42-795d-4c09-a67b-7c07c0d4a7af None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:43.655573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122109e-e806-44ea-bd14-952cb7f0ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:43.656249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122109e-e806-44ea-bd14-952cb7f0ce82 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.656548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122109e-e806-44ea-bd14-952cb7f0ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.656806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122109e-e806-44ea-bd14-952cb7f0ce82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.657510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122109e-e806-44ea-bd14-952cb7f0ce82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:43.659515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122109e-e806-44ea-bd14-952cb7f0ce82 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:43.688990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1311/2607] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:43 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:43.693569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:43.699922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:43.706811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcab1f-1222-4145-877b-0eca0d3b093f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:43.769974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc058aea-d851-4960-ab72-06b93a9569bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:43.770689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc058aea-d851-4960-ab72-06b93a9569bc admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.770994 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc058aea-d851-4960-ab72-06b93a9569bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.771290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc058aea-d851-4960-ab72-06b93a9569bc admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.772004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc058aea-d851-4960-ab72-06b93a9569bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:43.773967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc058aea-d851-4960-ab72-06b93a9569bc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:43.797024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1297/2608] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:43 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:43.801496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122109e-e806-44ea-bd14-952cb7f0ce82 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:43.812128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122109e-e806-44ea-bd14-952cb7f0ce82 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:43.816997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00c94f-7444-4630-ae41-af23ea8d42a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:43.817648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00c94f-7444-4630-ae41-af23ea8d42a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.817948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00c94f-7444-4630-ae41-af23ea8d42a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.818309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00c94f-7444-4630-ae41-af23ea8d42a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.819362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00c94f-7444-4630-ae41-af23ea8d42a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:43.820983 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00c94f-7444-4630-ae41-af23ea8d42a5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:43.832302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1312/2609] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:43.837003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc058aea-d851-4960-ab72-06b93a9569bc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:43.848641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc058aea-d851-4960-ab72-06b93a9569bc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:43.854640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31358753-6011-4b92-980f-3cc0870719c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:43.855467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31358753-6011-4b92-980f-3cc0870719c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.855745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31358753-6011-4b92-980f-3cc0870719c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.856017 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31358753-6011-4b92-980f-3cc0870719c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.856754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31358753-6011-4b92-980f-3cc0870719c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:43.858336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31358753-6011-4b92-980f-3cc0870719c2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:43.870085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1298/2610] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:43.874991 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00c94f-7444-4630-ae41-af23ea8d42a5 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:43.886492 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00c94f-7444-4630-ae41-af23ea8d42a5 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:43.891537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:43.892439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.892719 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.892992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] PATH_INFO: `/v3/projects/dcac56b25ccb4aff85af53296d8250e9/users/16e9370ad6b748da8946fd27686ce422/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.908518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcac56b25ccb4aff85af53296d8250e9, user_id=16e9370ad6b748da8946fd27686ce422, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:43.911264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:43.926584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1313/2611] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:43 2022] PUT /identity/v3/projects/dcac56b25ccb4aff85af53296d8250e9/users/16e9370ad6b748da8946fd27686ce422/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:43.932239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854f0a-f443-4166-be69-9cc175c80503 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:43.932532 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854f0a-f443-4166-be69-9cc175c80503 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:43.932806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854f0a-f443-4166-be69-9cc175c80503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:43.953469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dc854f0a-f443-4166-be69-9cc175c80503 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:43.954728 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dc854f0a-f443-4166-be69-9cc175c80503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:44.021699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1299/2612] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:44.031964 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:44.034036 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:44.096436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc8ca-79ad-4c5a-bce2-0cd981ee8719 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:44.100713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:44.101633 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:44.101923 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:44.102193 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:44.111965 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:44.113431 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:44.123926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1314/2613] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:48.886890 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625346-8c06-414e-8117-4999ca882a0d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:48.887645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625346-8c06-414e-8117-4999ca882a0d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:48.888048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625346-8c06-414e-8117-4999ca882a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:48.932178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a7625346-8c06-414e-8117-4999ca882a0d None None] MFA Rules not processed for user `16e9370ad6b748da8946fd27686ce422`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:48.933718 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a7625346-8c06-414e-8117-4999ca882a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:49.009965 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1300/2614] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:49.024507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:49.026013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:49.033272 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:49.140829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c3855-ac0d-4a80-9718-12703fec1d61 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:49.148508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fee75-9761-4674-b001-7f71dc38b863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:49.149235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fee75-9761-4674-b001-7f71dc38b863 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:49.149565 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fee75-9761-4674-b001-7f71dc38b863 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:49.149885 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fee75-9761-4674-b001-7f71dc38b863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:49.160555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fee75-9761-4674-b001-7f71dc38b863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:49.162887 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fee75-9761-4674-b001-7f71dc38b863 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:49.175115 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1315/2615] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:50.850682 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd835-0a16-4ae3-8f42-4a7935c4e8aa None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:50.851227 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd835-0a16-4ae3-8f42-4a7935c4e8aa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:50.851357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd835-0a16-4ae3-8f42-4a7935c4e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:50.871022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-891bd835-0a16-4ae3-8f42-4a7935c4e8aa None None] MFA Rules not processed for user `16e9370ad6b748da8946fd27686ce422`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:50.872427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-891bd835-0a16-4ae3-8f42-4a7935c4e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:50.881128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1301/2616] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:33:51.288479 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fee75-9761-4674-b001-7f71dc38b863 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:51.302105 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fee75-9761-4674-b001-7f71dc38b863 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:51.306953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:51.307641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:51.307993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:51.308301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:51.310849 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:51.327361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:51.330927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:51.343433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1316/2617] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:51.745094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd835-0a16-4ae3-8f42-4a7935c4e8aa None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:51.747310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-891bd835-0a16-4ae3-8f42-4a7935c4e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:51.764338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:51.851381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd835-0a16-4ae3-8f42-4a7935c4e8aa None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:51.860696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:51.861652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:51.862098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:51.862534 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:51.866348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:51.887380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:51.890026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:51.900908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1302/2618] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:57.590414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:57.592742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:57.609981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1774-3951-4363-9e50-93512ee89baf service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:57.615309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:57.616032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:57.616384 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:57.616666 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:57.618531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:57.632280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:57.634410 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:57.652353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:57.654648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:57.660190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1317/2619] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:57.675415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ffb25-3d74-410c-9184-141d6c9bd9a2 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:57.681809 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:57.683664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:57.686380 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:57.686717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] PATH_INFO: `/v3/users/f8a9929565fe44d680a0b2f7d8065b4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:57.689079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a9929565fe44d680a0b2f7d8065b4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:57.691328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:57.758835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a9929565fe44d680a0b2f7d8065b4b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:57.777484 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a9929565fe44d680a0b2f7d8065b4b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:57.778404 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a9929565fe44d680a0b2f7d8065b4b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:57.788315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a9929565fe44d680a0b2f7d8065b4b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:57.791664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f759b6a9-6678-436a-a7e1-0c2aba1c3a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a9929565fe44d680a0b2f7d8065b4b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:57.813143 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1303/2620] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:57 2022] DELETE /identity/v3/users/f8a9929565fe44d680a0b2f7d8065b4b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:58.019493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:58.033155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7deaa-496e-4dd9-9585-cbb0e787b8e6 service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:58.127746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:58.128624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.128918 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.129245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] PATH_INFO: `/v3/projects/2dcb127ee3184ea6a44d2e2af8fc52ab` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.130567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcb127ee3184ea6a44d2e2af8fc52ab)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:58.132668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:58.194478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcb127ee3184ea6a44d2e2af8fc52ab', 'request_id': 'req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:58.205072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcb127ee3184ea6a44d2e2af8fc52ab', 'request_id': 'req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:58.213554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcb127ee3184ea6a44d2e2af8fc52ab', 'request_id': 'req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:58.214927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:58.230721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] The token cache is being invalidate because project 2dcb127ee3184ea6a44d2e2af8fc52ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:58.231062 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:58.232430 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-ab6f86e5-dae1-448f-b7c4-4b53ff44e33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:58.235196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1318/2621] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:58 2022] DELETE /identity/v3/projects/2dcb127ee3184ea6a44d2e2af8fc52ab => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:58.241780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfca9e2-f09a-4306-a458-07768a4ccffc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.242402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfca9e2-f09a-4306-a458-07768a4ccffc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.242810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfca9e2-f09a-4306-a458-07768a4ccffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.270179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5cfca9e2-f09a-4306-a458-07768a4ccffc None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:58.271946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5cfca9e2-f09a-4306-a458-07768a4ccffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:58.356735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1304/2622] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:58.365477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afffd-ffff-4b10-8915-904864a24e27 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.365810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afffd-ffff-4b10-8915-904864a24e27 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.366135 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afffd-ffff-4b10-8915-904864a24e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.387349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-228afffd-ffff-4b10-8915-904864a24e27 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:58.388657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-228afffd-ffff-4b10-8915-904864a24e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:58.397902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1319/2623] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:58.402698 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfca9e2-f09a-4306-a458-07768a4ccffc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:58.413031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfca9e2-f09a-4306-a458-07768a4ccffc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:58.417796 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:58.418488 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.418762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.419065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.419798 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:33:58.420094 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:58.421767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:58.423352 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:58.441996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1305/2624] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:33:58.446537 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afffd-ffff-4b10-8915-904864a24e27 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:58.460407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afffd-ffff-4b10-8915-904864a24e27 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:58.467545 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1855f-009d-49d2-8de8-63938e771dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:58.468407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1855f-009d-49d2-8de8-63938e771dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.468902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1855f-009d-49d2-8de8-63938e771dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.469271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1855f-009d-49d2-8de8-63938e771dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.470419 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1855f-009d-49d2-8de8-63938e771dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:58.472993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1855f-009d-49d2-8de8-63938e771dd4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:58.512515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1320/2625] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:58 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:58.517317 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:58.530449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc13bd7-06ec-4e28-b455-ddc1dd92f4ae admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:58.605934 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9dcc1-2643-4276-8f55-90bd44eceea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:58.607022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9dcc1-2643-4276-8f55-90bd44eceea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.607514 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9dcc1-2643-4276-8f55-90bd44eceea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.608025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9dcc1-2643-4276-8f55-90bd44eceea5 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.609455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9dcc1-2643-4276-8f55-90bd44eceea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:58.612133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9dcc1-2643-4276-8f55-90bd44eceea5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:58.643969 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1306/2626] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:58 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:58.649771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1855f-009d-49d2-8de8-63938e771dd4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:58.664268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1855f-009d-49d2-8de8-63938e771dd4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:58.673246 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c252e7-dfb4-4832-bf91-00e8d04e5cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:58.674462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c252e7-dfb4-4832-bf91-00e8d04e5cec admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.675014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c252e7-dfb4-4832-bf91-00e8d04e5cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.675518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c252e7-dfb4-4832-bf91-00e8d04e5cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.676834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c252e7-dfb4-4832-bf91-00e8d04e5cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:58.680114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c252e7-dfb4-4832-bf91-00e8d04e5cec admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:58.701213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1321/2627] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:58.702541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9dcc1-2643-4276-8f55-90bd44eceea5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:58.713727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9dcc1-2643-4276-8f55-90bd44eceea5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:58.719079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb9903-13c9-48eb-936b-728fe291f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:58.719857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9903-13c9-48eb-936b-728fe291f0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.720202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9903-13c9-48eb-936b-728fe291f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.720545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb9903-13c9-48eb-936b-728fe291f0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.721379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb9903-13c9-48eb-936b-728fe291f0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:58.723234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb9903-13c9-48eb-936b-728fe291f0a1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:58.735371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1307/2628] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:58.739415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c252e7-dfb4-4832-bf91-00e8d04e5cec admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:58.757174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c252e7-dfb4-4832-bf91-00e8d04e5cec admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:58.764825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:58.765750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.766030 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.766306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] PATH_INFO: `/v3/projects/40c952d0938b4ca8969139b924473261/users/a5e1a82a4acf48c5a82c381e50bbe408/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.783874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c952d0938b4ca8969139b924473261, user_id=a5e1a82a4acf48c5a82c381e50bbe408, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:58.787174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:58.803731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1322/2629] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:58 2022] PUT /identity/v3/projects/40c952d0938b4ca8969139b924473261/users/a5e1a82a4acf48c5a82c381e50bbe408/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:58.809459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced001b6-fa8c-4008-aa64-60d060d4b935 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.809747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced001b6-fa8c-4008-aa64-60d060d4b935 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.810030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced001b6-fa8c-4008-aa64-60d060d4b935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:58.832763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ced001b6-fa8c-4008-aa64-60d060d4b935 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:58.833935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ced001b6-fa8c-4008-aa64-60d060d4b935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:58.910607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1308/2630] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:58.921393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:58.923500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:58.984664 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af730194-8ab9-4e20-99ef-a8f73db1cacd admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:58.988418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256020b2-bd67-4a95-87a8-e7f21d363457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:58.989100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256020b2-bd67-4a95-87a8-e7f21d363457 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:58.989387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256020b2-bd67-4a95-87a8-e7f21d363457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:58.989665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256020b2-bd67-4a95-87a8-e7f21d363457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:59.001635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256020b2-bd67-4a95-87a8-e7f21d363457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:59.003134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256020b2-bd67-4a95-87a8-e7f21d363457 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:59.013814 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1323/2631] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:00.843850 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced001b6-fa8c-4008-aa64-60d060d4b935 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:00.856356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced001b6-fa8c-4008-aa64-60d060d4b935 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:00.861194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:00.862070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:00.862476 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:00.862784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:00.865295 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:00.880556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:00.881985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:00.892992 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1309/2632] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:03.752595 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1cd59-597a-4059-bfa3-e48d91fcefbe None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:03.753200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1cd59-597a-4059-bfa3-e48d91fcefbe None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:03.753200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1cd59-597a-4059-bfa3-e48d91fcefbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:03.791804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8af1cd59-597a-4059-bfa3-e48d91fcefbe None None] MFA Rules not processed for user `a5e1a82a4acf48c5a82c381e50bbe408`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:03.794884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8af1cd59-597a-4059-bfa3-e48d91fcefbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:03.894513 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1324/2633] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:34:03.904523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:03.907616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:03.991374 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:04.015051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea7570-476d-4922-be11-16f67638def4 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:04.023398 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112af7a-efaf-4822-9ad4-8b08eda0f9cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:04.024625 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112af7a-efaf-4822-9ad4-8b08eda0f9cc service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:04.025126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112af7a-efaf-4822-9ad4-8b08eda0f9cc service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:04.025648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112af7a-efaf-4822-9ad4-8b08eda0f9cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:04.041819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112af7a-efaf-4822-9ad4-8b08eda0f9cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:04.045148 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112af7a-efaf-4822-9ad4-8b08eda0f9cc service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:04.063357 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1310/2634] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:04.343396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1cd59-597a-4059-bfa3-e48d91fcefbe None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:04.345028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8af1cd59-597a-4059-bfa3-e48d91fcefbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:04.365707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1cd59-597a-4059-bfa3-e48d91fcefbe None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:04.375131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:04.376167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:04.377021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:04.377367 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:04.380072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:04.398308 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:04.400029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:04.412662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1325/2635] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:05.942807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219febc-156b-4366-bde4-e3d71f167bfb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:05.943415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219febc-156b-4366-bde4-e3d71f167bfb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:05.943415 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219febc-156b-4366-bde4-e3d71f167bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:05.970066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b219febc-156b-4366-bde4-e3d71f167bfb None None] MFA Rules not processed for user `a5e1a82a4acf48c5a82c381e50bbe408`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:05.971659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b219febc-156b-4366-bde4-e3d71f167bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:05.984041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1311/2636] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:34:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:06.712725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:06.714437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:06.729117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b551038-24af-4e89-b6cf-d86510950428 service nova] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:06.735815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64dff6-b726-4fc8-8cf9-e692406d7ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:06.737408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dff6-b726-4fc8-8cf9-e692406d7ffd service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:06.738044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dff6-b726-4fc8-8cf9-e692406d7ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:06.738670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dff6-b726-4fc8-8cf9-e692406d7ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:06.741073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0c64dff6-b726-4fc8-8cf9-e692406d7ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:06.754126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:06.760556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64dff6-b726-4fc8-8cf9-e692406d7ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:06.762764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64dff6-b726-4fc8-8cf9-e692406d7ffd service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:06.776884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1326/2637] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:15.962573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:16.770092 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:32.787974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7561-2fb7-4b60-9aad-176282d06cb4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:32.788807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7561-2fb7-4b60-9aad-176282d06cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:32.788807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7561-2fb7-4b60-9aad-176282d06cb4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:32.790388 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1312/2638] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:34:32.797408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba465b-2789-4cea-af09-703ff9b98974 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:32.798013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba465b-2789-4cea-af09-703ff9b98974 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:32.798013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba465b-2789-4cea-af09-703ff9b98974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:32.818515 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b9ba465b-2789-4cea-af09-703ff9b98974 None None] MFA Rules not processed for user `3894e1d2983e4040a4b0ae92ce794f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:32.819750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9ba465b-2789-4cea-af09-703ff9b98974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:32.827418 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1327/2639] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:34:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:34:32.839438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc7561-2fb7-4b60-9aad-176282d06cb4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:32.851913 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc7561-2fb7-4b60-9aad-176282d06cb4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:32.858014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eee0c-924d-41d2-bb0c-35948e105450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:32.858949 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eee0c-924d-41d2-bb0c-35948e105450 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:32.859382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eee0c-924d-41d2-bb0c-35948e105450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:32.859779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eee0c-924d-41d2-bb0c-35948e105450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:32.870319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758eee0c-924d-41d2-bb0c-35948e105450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:32.872539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758eee0c-924d-41d2-bb0c-35948e105450 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:32.882902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1313/2640] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:32.981253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed504e-4bb8-4001-b0b4-ec94c2b9ff3b None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:32.981509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed504e-4bb8-4001-b0b4-ec94c2b9ff3b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:32.981815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed504e-4bb8-4001-b0b4-ec94c2b9ff3b None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:32.983842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1328/2641] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:34:32.991251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b71fd-8e61-45ed-8313-11cd69df21cb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:32.991594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b71fd-8e61-45ed-8313-11cd69df21cb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:32.991918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b71fd-8e61-45ed-8313-11cd69df21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:33.013452 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-777b71fd-8e61-45ed-8313-11cd69df21cb None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:33.014629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-777b71fd-8e61-45ed-8313-11cd69df21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:33.027140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1314/2642] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:34:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:33.039904 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed504e-4bb8-4001-b0b4-ec94c2b9ff3b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:33.052236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed504e-4bb8-4001-b0b4-ec94c2b9ff3b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:33.056099 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a35c2-ab7b-416b-8d8d-df6a70ba1691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:33.056761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a35c2-ab7b-416b-8d8d-df6a70ba1691 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:33.057045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a35c2-ab7b-416b-8d8d-df6a70ba1691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:33.057311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a35c2-ab7b-416b-8d8d-df6a70ba1691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:33.068968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a35c2-ab7b-416b-8d8d-df6a70ba1691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:33.070657 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a35c2-ab7b-416b-8d8d-df6a70ba1691 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:33.082792 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1329/2643] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:36.373381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b71fd-8e61-45ed-8313-11cd69df21cb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:36.388915 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b71fd-8e61-45ed-8313-11cd69df21cb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:36.402462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:36.402960 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:36.403328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:36.403951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:36.407763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:36.426650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:36.428875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:36.443298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1315/2644] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:43.077584 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=9 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:44.247451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8e415-beaf-4697-8605-d3b6163731ff None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:44.248406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8e415-beaf-4697-8605-d3b6163731ff None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:44.248406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8e415-beaf-4697-8605-d3b6163731ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:44.266316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-9fb8e415-beaf-4697-8605-d3b6163731ff None None] MFA Rules not processed for user `16e9370ad6b748da8946fd27686ce422`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:44.267561 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9fb8e415-beaf-4697-8605-d3b6163731ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:44.323114 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1330/2645] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:34:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:46.437866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=15 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:54.315796 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=25 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:57.057912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:57.071255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aea2f-d670-4f76-b865-d5fda12cb449 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:57.078256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:57.079132 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:57.079429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:57.079694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:57.081665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:57.094840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:57.096582 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:57.107708 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1316/2646] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:07.103811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:19.916532 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed8c60-7988-4117-bd70-6aaaea0817c2 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:19.917080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed8c60-7988-4117-bd70-6aaaea0817c2 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:19.917080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed8c60-7988-4117-bd70-6aaaea0817c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:19.936353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-14ed8c60-7988-4117-bd70-6aaaea0817c2 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:19.937466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-14ed8c60-7988-4117-bd70-6aaaea0817c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:19.997567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1331/2647] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:35:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:35:20.042031 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:20.043610 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:20.117325 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003db8c5-9f81-4acd-9bc7-f81d01742274 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:20.123194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e04ec-c35a-4292-824e-693cdae0e7f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:20.124157 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e04ec-c35a-4292-824e-693cdae0e7f1 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:20.124433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e04ec-c35a-4292-824e-693cdae0e7f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:20.124706 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e04ec-c35a-4292-824e-693cdae0e7f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:20.133158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e04ec-c35a-4292-824e-693cdae0e7f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:20.134830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e04ec-c35a-4292-824e-693cdae0e7f1 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:20.142908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1317/2648] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:35:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:35:29.990497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=25 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:30.139830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=32 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:33.302821 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deff5e-bd85-4a99-b67e-f0f4783a8b03 None None] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:33.303448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deff5e-bd85-4a99-b67e-f0f4783a8b03 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:33.303676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deff5e-bd85-4a99-b67e-f0f4783a8b03 None None] PATH_INFO: `/` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:33.305369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1332/2649] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jul 20 15:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:35:33.310922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b240-161b-41c7-a163-31204f88c120 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:33.311465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b240-161b-41c7-a163-31204f88c120 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:33.311583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b240-161b-41c7-a163-31204f88c120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:33.330373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1f88b240-161b-41c7-a163-31204f88c120 None None] MFA Rules not processed for user `29c52f8ffcc34046ac3ade9723bf8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:33.331657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1f88b240-161b-41c7-a163-31204f88c120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:33.343980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1318/2650] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jul 20 15:35:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:33.358079 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deff5e-bd85-4a99-b67e-f0f4783a8b03 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:33.359776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f6deff5e-bd85-4a99-b67e-f0f4783a8b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:33.430883 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deff5e-bd85-4a99-b67e-f0f4783a8b03 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:33.435871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70c82-5468-47ce-904f-8636e1893cc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac481e3d57a4b6fa07c120ca26f2e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:33.436676 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70c82-5468-47ce-904f-8636e1893cc1 service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:33.436960 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70c82-5468-47ce-904f-8636e1893cc1 service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:33.437232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70c82-5468-47ce-904f-8636e1893cc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:33.449604 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb70c82-5468-47ce-904f-8636e1893cc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:33.451232 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb70c82-5468-47ce-904f-8636e1893cc1 service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:33.473009 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1333/2651] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:37.270196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c033-3cd5-45af-8dd8-931ce3d037cd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:37.271207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c033-3cd5-45af-8dd8-931ce3d037cd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:37.271508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c033-3cd5-45af-8dd8-931ce3d037cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:37.290209 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d5f2c033-3cd5-45af-8dd8-931ce3d037cd None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:37.292099 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d5f2c033-3cd5-45af-8dd8-931ce3d037cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:37.301189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1319/2652] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:35:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:35:37.313875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70c82-5468-47ce-904f-8636e1893cc1 service glance] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:37.325726 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70c82-5468-47ce-904f-8636e1893cc1 service glance] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:37.331249 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a52de-aae4-486c-821b-836ad418472d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:37.331972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a52de-aae4-486c-821b-836ad418472d service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:37.332469 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a52de-aae4-486c-821b-836ad418472d service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:37.332743 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a52de-aae4-486c-821b-836ad418472d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:37.342459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a52de-aae4-486c-821b-836ad418472d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:37.344171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a52de-aae4-486c-821b-836ad418472d service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:37.357896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1334/2653] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:35:47.285062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:47.350892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=32 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:52.717620 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5213a-f770-4ba8-8a44-a90441c2eb5d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:52.718190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5213a-f770-4ba8-8a44-a90441c2eb5d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:52.718190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5213a-f770-4ba8-8a44-a90441c2eb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:52.737490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-91c5213a-f770-4ba8-8a44-a90441c2eb5d None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:52.738847 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-91c5213a-f770-4ba8-8a44-a90441c2eb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:52.747985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1320/2654] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jul 20 15:35:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:52.762544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a52de-aae4-486c-821b-836ad418472d service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:52.782156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a52de-aae4-486c-821b-836ad418472d service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:52.788342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:52.789008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:52.789290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:52.789564 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:52.799221 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:52.801013 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:52.811182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1335/2655] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:35:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:35:55.960354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72f33-3ffe-44ef-aec7-2cf48973585b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:55.960908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72f33-3ffe-44ef-aec7-2cf48973585b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:55.960908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72f33-3ffe-44ef-aec7-2cf48973585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:55.986663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3da72f33-3ffe-44ef-aec7-2cf48973585b None None] MFA Rules not processed for user `16e9370ad6b748da8946fd27686ce422`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:55.988120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3da72f33-3ffe-44ef-aec7-2cf48973585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:55.996373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1321/2656] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:36:02.807002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:05.741527 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:05.743238 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:05.799370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da72f33-3ffe-44ef-aec7-2cf48973585b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:05.801631 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3da72f33-3ffe-44ef-aec7-2cf48973585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:05.816763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da72f33-3ffe-44ef-aec7-2cf48973585b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:05.821431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:05.822319 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:05.822602 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:05.822877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] PATH_INFO: `/v3/users/3a1da964b16b4b0b92d84274cb973553` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:05.824123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1da964b16b4b0b92d84274cb973553)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:05.826051 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:05.833984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc99b81-9041-4c54-a792-df549bb57cb6 service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:05.839128 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:05.839815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:05.840098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:05.840373 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:05.842170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:05.854200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:05.855863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:05.866769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1336/2657] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:05.879205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1da964b16b4b0b92d84274cb973553'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:05.902083 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1da964b16b4b0b92d84274cb973553'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:05.903105 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1da964b16b4b0b92d84274cb973553'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:05.910640 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1da964b16b4b0b92d84274cb973553'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:05.911735 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1da964b16b4b0b92d84274cb973553'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:05.925235 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1322/2658] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:36:05 2022] DELETE /identity/v3/users/3a1da964b16b4b0b92d84274cb973553 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:36:06.132744 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:06.144001 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa4c6-0608-4121-a489-851ceb0d7eca service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:06.222712 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:06.223735 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:06.224028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:06.224302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] PATH_INFO: `/v3/projects/ff831dd38308489fbcec5e161337f44e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:06.225648 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff831dd38308489fbcec5e161337f44e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:06.227706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:06.283282 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff831dd38308489fbcec5e161337f44e', 'request_id': 'req-381bc602-c801-4ef6-ba16-29e7945bf616'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.291453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff831dd38308489fbcec5e161337f44e', 'request_id': 'req-381bc602-c801-4ef6-ba16-29e7945bf616'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.297175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff831dd38308489fbcec5e161337f44e', 'request_id': 'req-381bc602-c801-4ef6-ba16-29e7945bf616'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.308283 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] The token cache is being invalidate because project ff831dd38308489fbcec5e161337f44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:36:06.308548 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.309194 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.310802 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1337/2659] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:36:06 2022] DELETE /identity/v3/projects/ff831dd38308489fbcec5e161337f44e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:36:06.314983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:06.316376 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:06.329892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b088c-4bc0-4747-be05-6f925175d7f9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:06.520727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:06.521633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:06.521914 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:06.522270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] PATH_INFO: `/v3/users/747d6343930b4beea1a46b156bcbaa3f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:06.523575 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747d6343930b4beea1a46b156bcbaa3f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:06.526926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:06.590896 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747d6343930b4beea1a46b156bcbaa3f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.601430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:06.604353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747d6343930b4beea1a46b156bcbaa3f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.605395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747d6343930b4beea1a46b156bcbaa3f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.620951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747d6343930b4beea1a46b156bcbaa3f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.622163 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-478bea63-2329-40ff-978e-60c2e5cfa606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747d6343930b4beea1a46b156bcbaa3f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.643909 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1323/2660] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:36:06 2022] DELETE /identity/v3/users/747d6343930b4beea1a46b156bcbaa3f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:36:06.823905 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:06.825895 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:06.846658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bc602-c801-4ef6-ba16-29e7945bf616 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:06.869480 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:06.917878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:06.918810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:06.919127 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:06.919404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] PATH_INFO: `/v3/projects/0208366b33bb4c9db636c6f68d2fb5b3` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:06.920717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0208366b33bb4c9db636c6f68d2fb5b3)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:06.922732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:06.974522 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0208366b33bb4c9db636c6f68d2fb5b3', 'request_id': 'req-88680abe-b6d7-4fb3-ab29-08eede1ddc29'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.982459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0208366b33bb4c9db636c6f68d2fb5b3', 'request_id': 'req-88680abe-b6d7-4fb3-ab29-08eede1ddc29'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:06.988603 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0208366b33bb4c9db636c6f68d2fb5b3', 'request_id': 'req-88680abe-b6d7-4fb3-ab29-08eede1ddc29'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:07.001759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] The token cache is being invalidate because project 0208366b33bb4c9db636c6f68d2fb5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:36:07.001997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:07.002809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:36:07.004725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1338/2661] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:36:06 2022] DELETE /identity/v3/projects/0208366b33bb4c9db636c6f68d2fb5b3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:36:16.639858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:16.997746 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:34.358946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f376e-48cb-405c-b586-cb8f818a1e63 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:34.359490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f376e-48cb-405c-b586-cb8f818a1e63 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:34.359606 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f376e-48cb-405c-b586-cb8f818a1e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:34.387775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-186f376e-48cb-405c-b586-cb8f818a1e63 None None] MFA Rules not processed for user `a5e1a82a4acf48c5a82c381e50bbe408`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:34.389022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-186f376e-48cb-405c-b586-cb8f818a1e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:34.473591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1324/2662] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:36:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:36:44.471160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=37 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:45.025270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:45.027818 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:45.178126 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680abe-b6d7-4fb3-ab29-08eede1ddc29 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:45.183891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e633cf-3641-4b96-a828-6c116e2f4cd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:45.184558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e633cf-3641-4b96-a828-6c116e2f4cd7 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:45.184839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e633cf-3641-4b96-a828-6c116e2f4cd7 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:45.185111 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e633cf-3641-4b96-a828-6c116e2f4cd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:45.187004 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d5e633cf-3641-4b96-a828-6c116e2f4cd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:45.199554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e633cf-3641-4b96-a828-6c116e2f4cd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:45.201212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e633cf-3641-4b96-a828-6c116e2f4cd7 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:45.212369 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1339/2663] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:55.207427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=59 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:55.581806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9898a0-7b32-47f7-b95e-74d50672f3c2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:55.582339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9898a0-7b32-47f7-b95e-74d50672f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:55.582339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9898a0-7b32-47f7-b95e-74d50672f3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:55.604101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5c9898a0-7b32-47f7-b95e-74d50672f3c2 None None] MFA Rules not processed for user `16e9370ad6b748da8946fd27686ce422`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:55.605298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5c9898a0-7b32-47f7-b95e-74d50672f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:55.665977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1325/2664] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:36:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:37:05.656254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=25 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:42.496897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b232c1-9b24-4b91-babd-fc8ecb4f92e5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:42.498096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b232c1-9b24-4b91-babd-fc8ecb4f92e5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:42.498441 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b232c1-9b24-4b91-babd-fc8ecb4f92e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:42.539421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-48b232c1-9b24-4b91-babd-fc8ecb4f92e5 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:37:42.540658 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-48b232c1-9b24-4b91-babd-fc8ecb4f92e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:42.625417 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1340/2665] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:37:42.693019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9898a0-7b32-47f7-b95e-74d50672f3c2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:42.695182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5c9898a0-7b32-47f7-b95e-74d50672f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:42.780370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9898a0-7b32-47f7-b95e-74d50672f3c2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:42.788260 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559609c-1e32-4a5b-83aa-3e7a55898383 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:42.788987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559609c-1e32-4a5b-83aa-3e7a55898383 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:42.789274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559609c-1e32-4a5b-83aa-3e7a55898383 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:42.790350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559609c-1e32-4a5b-83aa-3e7a55898383 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:42.801568 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559609c-1e32-4a5b-83aa-3e7a55898383 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:42.803290 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559609c-1e32-4a5b-83aa-3e7a55898383 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:42.813259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1326/2666] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:37:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:37:52.616927 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=32 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:52.808983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=32 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:58.886831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d1b25-b754-48ad-9eab-297f039e94da None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:58.887394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d1b25-b754-48ad-9eab-297f039e94da None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:58.887495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d1b25-b754-48ad-9eab-297f039e94da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:58.923517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e72d1b25-b754-48ad-9eab-297f039e94da None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:37:58.925311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e72d1b25-b754-48ad-9eab-297f039e94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:58.935900 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1341/2667] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:37:58.955417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559609c-1e32-4a5b-83aa-3e7a55898383 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:58.967098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559609c-1e32-4a5b-83aa-3e7a55898383 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:58.973508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe4d71-59bc-4576-96b8-fd464d65b6f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:58.974180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe4d71-59bc-4576-96b8-fd464d65b6f3 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:58.974462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe4d71-59bc-4576-96b8-fd464d65b6f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:58.974742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe4d71-59bc-4576-96b8-fd464d65b6f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:58.984793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe4d71-59bc-4576-96b8-fd464d65b6f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:58.986843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe4d71-59bc-4576-96b8-fd464d65b6f3 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:58.999140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1327/2668] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:37:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:38:00.347826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d1b25-b754-48ad-9eab-297f039e94da None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:00.352251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e72d1b25-b754-48ad-9eab-297f039e94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:00.470842 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d1b25-b754-48ad-9eab-297f039e94da None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:00.476192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:00.477097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:00.477580 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:00.478029 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] PATH_INFO: `/v3/users/16e9370ad6b748da8946fd27686ce422` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:00.479302 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e9370ad6b748da8946fd27686ce422)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:00.481252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:00.530336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e9370ad6b748da8946fd27686ce422'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:00.543167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e9370ad6b748da8946fd27686ce422'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:00.543942 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e9370ad6b748da8946fd27686ce422'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:00.544555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e9370ad6b748da8946fd27686ce422'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:00.551644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5cda8c38-0b77-46b9-bc42-b742784f51a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e9370ad6b748da8946fd27686ce422'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:00.566582 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1342/2669] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:00 2022] DELETE /identity/v3/users/16e9370ad6b748da8946fd27686ce422 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:00.797983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe4d71-59bc-4576-96b8-fd464d65b6f3 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:00.812633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe4d71-59bc-4576-96b8-fd464d65b6f3 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:00.919120 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:00.920216 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:00.920576 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:00.920940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] PATH_INFO: `/v3/projects/dcac56b25ccb4aff85af53296d8250e9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:00.922362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcac56b25ccb4aff85af53296d8250e9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:00.926082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:01.001104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcac56b25ccb4aff85af53296d8250e9', 'request_id': 'req-ec1071b8-6cd0-46d2-b71b-b896d8995b96'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:01.010923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcac56b25ccb4aff85af53296d8250e9', 'request_id': 'req-ec1071b8-6cd0-46d2-b71b-b896d8995b96'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:01.019389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcac56b25ccb4aff85af53296d8250e9', 'request_id': 'req-ec1071b8-6cd0-46d2-b71b-b896d8995b96'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:01.032381 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] The token cache is being invalidate because project dcac56b25ccb4aff85af53296d8250e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:01.032941 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:01.033828 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ec1071b8-6cd0-46d2-b71b-b896d8995b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:01.040037 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1328/2670] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:00 2022] DELETE /identity/v3/projects/dcac56b25ccb4aff85af53296d8250e9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:01.041041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963879a4-887a-4f2c-97c5-114aab74938e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.041342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963879a4-887a-4f2c-97c5-114aab74938e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.041628 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963879a4-887a-4f2c-97c5-114aab74938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.112563 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-963879a4-887a-4f2c-97c5-114aab74938e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:01.113700 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-963879a4-887a-4f2c-97c5-114aab74938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:01.122350 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:01.176812 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1343/2671] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:38:01.184942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e30c7-78ab-45bf-abb1-82bddc8d3c0e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.185225 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e30c7-78ab-45bf-abb1-82bddc8d3c0e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.185591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e30c7-78ab-45bf-abb1-82bddc8d3c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.209412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bf5e30c7-78ab-45bf-abb1-82bddc8d3c0e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:01.210999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bf5e30c7-78ab-45bf-abb1-82bddc8d3c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:01.226858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1329/2672] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:01.227468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963879a4-887a-4f2c-97c5-114aab74938e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:01.237926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963879a4-887a-4f2c-97c5-114aab74938e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:01.243299 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:01.244271 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.244691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.245167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.246396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:38:01.246701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:01.248525 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:01.270253 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1344/2673] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:38:01.275284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e30c7-78ab-45bf-abb1-82bddc8d3c0e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:01.285100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e30c7-78ab-45bf-abb1-82bddc8d3c0e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:01.290284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ca7f-d4d4-4ec3-9fd1-9249cd12d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:01.290999 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ca7f-d4d4-4ec3-9fd1-9249cd12d28b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.291307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ca7f-d4d4-4ec3-9fd1-9249cd12d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.291580 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ca7f-d4d4-4ec3-9fd1-9249cd12d28b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.292341 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505ca7f-d4d4-4ec3-9fd1-9249cd12d28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:01.294270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505ca7f-d4d4-4ec3-9fd1-9249cd12d28b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:01.330136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1330/2674] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:01 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:38:01.337327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:01.350416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e84b9-494f-4a6c-a588-0e6e4c632305 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:01.428766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2dbd4-471b-406d-8179-f4c54b6c3ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:01.430764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2dbd4-471b-406d-8179-f4c54b6c3ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.430764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2dbd4-471b-406d-8179-f4c54b6c3ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.430764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2dbd4-471b-406d-8179-f4c54b6c3ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.430764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2dbd4-471b-406d-8179-f4c54b6c3ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:01.432809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2dbd4-471b-406d-8179-f4c54b6c3ae8 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:01.469992 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1345/2675] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:01 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:01.474649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ca7f-d4d4-4ec3-9fd1-9249cd12d28b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:01.487540 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ca7f-d4d4-4ec3-9fd1-9249cd12d28b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:01.495822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066bdb-7fbd-4f6f-9b62-457aa81cc5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:01.496535 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066bdb-7fbd-4f6f-9b62-457aa81cc5ef admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.496888 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066bdb-7fbd-4f6f-9b62-457aa81cc5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.497164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066bdb-7fbd-4f6f-9b62-457aa81cc5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.503633 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066bdb-7fbd-4f6f-9b62-457aa81cc5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:01.508621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066bdb-7fbd-4f6f-9b62-457aa81cc5ef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:01.535027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1331/2676] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:01.540097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2dbd4-471b-406d-8179-f4c54b6c3ae8 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:01.551445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2dbd4-471b-406d-8179-f4c54b6c3ae8 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:01.556466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba231df-c4da-44dd-a0bd-9bcfb1fadea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:01.557264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba231df-c4da-44dd-a0bd-9bcfb1fadea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.557593 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba231df-c4da-44dd-a0bd-9bcfb1fadea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.557963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba231df-c4da-44dd-a0bd-9bcfb1fadea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.558783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba231df-c4da-44dd-a0bd-9bcfb1fadea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:01.560544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba231df-c4da-44dd-a0bd-9bcfb1fadea4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:01.575023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1346/2677] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:01.578373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066bdb-7fbd-4f6f-9b62-457aa81cc5ef admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:01.589421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066bdb-7fbd-4f6f-9b62-457aa81cc5ef admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:01.600421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809cfc8-6306-4c03-b48e-4184379d8550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:01.605178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cfc8-6306-4c03-b48e-4184379d8550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.605515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cfc8-6306-4c03-b48e-4184379d8550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.605743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809cfc8-6306-4c03-b48e-4184379d8550 admin admin] PATH_INFO: `/v3/projects/a2239ba1aa154ce6b35c0954111d6a4a/users/1ab0d52ce5cd4a53a08e6f6f8293677a/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.644597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809cfc8-6306-4c03-b48e-4184379d8550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2239ba1aa154ce6b35c0954111d6a4a, user_id=1ab0d52ce5cd4a53a08e6f6f8293677a, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:01.647627 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809cfc8-6306-4c03-b48e-4184379d8550 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:01.676410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1332/2678] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:01 2022] PUT /identity/v3/projects/a2239ba1aa154ce6b35c0954111d6a4a/users/1ab0d52ce5cd4a53a08e6f6f8293677a/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:01.682990 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed1cd-6641-40c7-a8e9-05d4e2189794 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.683306 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed1cd-6641-40c7-a8e9-05d4e2189794 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.683544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ed1cd-6641-40c7-a8e9-05d4e2189794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.716782 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c66ed1cd-6641-40c7-a8e9-05d4e2189794 None None] MFA Rules not processed for user `1ab0d52ce5cd4a53a08e6f6f8293677a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:01.718146 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c66ed1cd-6641-40c7-a8e9-05d4e2189794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:01.804214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1347/2679] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:38:01.810523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809cfc8-6306-4c03-b48e-4184379d8550 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:01.828403 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:01.906339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809cfc8-6306-4c03-b48e-4184379d8550 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:01.912348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e613-8559-4579-b96f-c013724f3ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:01.913047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e613-8559-4579-b96f-c013724f3ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:01.913807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e613-8559-4579-b96f-c013724f3ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:01.913807 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e613-8559-4579-b96f-c013724f3ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:01.914348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652e613-8559-4579-b96f-c013724f3ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:01.916329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652e613-8559-4579-b96f-c013724f3ab7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:01.950551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1333/2680] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:01 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:38:01.953147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ed1cd-6641-40c7-a8e9-05d4e2189794 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:01.970825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ed1cd-6641-40c7-a8e9-05d4e2189794 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:01.977421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:02.053692 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc602ff-65b1-4521-89da-453e35575101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:02.054511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc602ff-65b1-4521-89da-453e35575101 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.054801 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc602ff-65b1-4521-89da-453e35575101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.055103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc602ff-65b1-4521-89da-453e35575101 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.055825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc602ff-65b1-4521-89da-453e35575101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:02.057820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc602ff-65b1-4521-89da-453e35575101 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:02.084165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1348/2681] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:01 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:02.088857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e613-8559-4579-b96f-c013724f3ab7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:02.101263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e613-8559-4579-b96f-c013724f3ab7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:02.107230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356873f-c8a4-4915-9328-f3e1226fa9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:02.108019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356873f-c8a4-4915-9328-f3e1226fa9de admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.108298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356873f-c8a4-4915-9328-f3e1226fa9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.108654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356873f-c8a4-4915-9328-f3e1226fa9de admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.109544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356873f-c8a4-4915-9328-f3e1226fa9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:02.111648 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356873f-c8a4-4915-9328-f3e1226fa9de admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:02.129200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1334/2682] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:02.130258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc602ff-65b1-4521-89da-453e35575101 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:02.141003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc602ff-65b1-4521-89da-453e35575101 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:02.146958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1325208-75fa-4203-b58a-a95c83d18312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:02.147963 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1325208-75fa-4203-b58a-a95c83d18312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.148250 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1325208-75fa-4203-b58a-a95c83d18312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.148528 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1325208-75fa-4203-b58a-a95c83d18312 admin admin] PATH_INFO: `/v3/projects/8207d3292dc64cf88e6b138e9b3f9e6a/users/69de3ac7bd9a4c8cb518b2131224964f/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.164864 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1325208-75fa-4203-b58a-a95c83d18312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8207d3292dc64cf88e6b138e9b3f9e6a, user_id=69de3ac7bd9a4c8cb518b2131224964f, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:02.168021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1325208-75fa-4203-b58a-a95c83d18312 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:02.182082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1349/2683] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:02 2022] PUT /identity/v3/projects/8207d3292dc64cf88e6b138e9b3f9e6a/users/69de3ac7bd9a4c8cb518b2131224964f/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:02.186541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356873f-c8a4-4915-9328-f3e1226fa9de admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:02.198259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356873f-c8a4-4915-9328-f3e1226fa9de admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:02.274384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c13a50-8873-426a-85a9-0bc56588440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:02.275119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13a50-8873-426a-85a9-0bc56588440f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.275438 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13a50-8873-426a-85a9-0bc56588440f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.275714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c13a50-8873-426a-85a9-0bc56588440f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.276477 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c13a50-8873-426a-85a9-0bc56588440f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:02.278166 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c13a50-8873-426a-85a9-0bc56588440f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:02.291014 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1335/2684] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:02.293813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1325208-75fa-4203-b58a-a95c83d18312 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:02.304896 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1325208-75fa-4203-b58a-a95c83d18312 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:02.309794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:02.310711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.311006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.311286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] PATH_INFO: `/v3/projects/8207d3292dc64cf88e6b138e9b3f9e6a/users/69de3ac7bd9a4c8cb518b2131224964f/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.313355 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8207d3292dc64cf88e6b138e9b3f9e6a, user_id=69de3ac7bd9a4c8cb518b2131224964f, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:02.316081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:02.327016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1350/2685] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:02 2022] PUT /identity/v3/projects/8207d3292dc64cf88e6b138e9b3f9e6a/users/69de3ac7bd9a4c8cb518b2131224964f/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:02.337712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f9f8-0915-4672-aba9-b2106ec8a30f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.338103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f9f8-0915-4672-aba9-b2106ec8a30f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.338379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f9f8-0915-4672-aba9-b2106ec8a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.376751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-82d7f9f8-0915-4672-aba9-b2106ec8a30f None None] MFA Rules not processed for user `69de3ac7bd9a4c8cb518b2131224964f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:02.378259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-82d7f9f8-0915-4672-aba9-b2106ec8a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:02.455830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1336/2686] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:02.477043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:02.484577 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:02.577576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9100fea-0efd-41b2-93c8-b40d8c645e31 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:02.582177 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a317f95-a139-475b-a08f-92c007433312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:02.583131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317f95-a139-475b-a08f-92c007433312 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.583614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317f95-a139-475b-a08f-92c007433312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.584138 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317f95-a139-475b-a08f-92c007433312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.595916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a317f95-a139-475b-a08f-92c007433312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:02.597622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a317f95-a139-475b-a08f-92c007433312 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:02.610000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1351/2687] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:03.146117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7f9f8-0915-4672-aba9-b2106ec8a30f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:03.156118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:03.225503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7f9f8-0915-4672-aba9-b2106ec8a30f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:03.230396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:03.231337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:03.231605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:03.231874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] PATH_INFO: `/v3/users/1ab0d52ce5cd4a53a08e6f6f8293677a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:03.233093 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab0d52ce5cd4a53a08e6f6f8293677a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:03.235059 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:03.283780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab0d52ce5cd4a53a08e6f6f8293677a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:03.295830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab0d52ce5cd4a53a08e6f6f8293677a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:03.296520 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab0d52ce5cd4a53a08e6f6f8293677a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:03.305230 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab0d52ce5cd4a53a08e6f6f8293677a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:03.306081 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab0d52ce5cd4a53a08e6f6f8293677a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:03.321346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1337/2688] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:03 2022] DELETE /identity/v3/users/1ab0d52ce5cd4a53a08e6f6f8293677a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:03.330750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4140f3d-7706-4dbe-9714-20edcafd415b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:03.331095 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4140f3d-7706-4dbe-9714-20edcafd415b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:03.331372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4140f3d-7706-4dbe-9714-20edcafd415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:03.358908 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b4140f3d-7706-4dbe-9714-20edcafd415b None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:03.360234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b4140f3d-7706-4dbe-9714-20edcafd415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:03.408408 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:03.428024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1352/2689] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:03.438098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:03.439595 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:03.524279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568f18b-bfe8-4609-b502-eaadadb2f63c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:03.528248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13de460-c6c5-4334-924a-cb0ab6914fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:03.528925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13de460-c6c5-4334-924a-cb0ab6914fba service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:03.529831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13de460-c6c5-4334-924a-cb0ab6914fba service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:03.529831 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13de460-c6c5-4334-924a-cb0ab6914fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:03.541054 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13de460-c6c5-4334-924a-cb0ab6914fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:03.542543 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13de460-c6c5-4334-924a-cb0ab6914fba service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:03.552879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1338/2690] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:03.888691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4140f3d-7706-4dbe-9714-20edcafd415b None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:03.890243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b4140f3d-7706-4dbe-9714-20edcafd415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:03.904098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4140f3d-7706-4dbe-9714-20edcafd415b None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:03.910352 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:03.911298 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:03.911737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:03.912014 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] PATH_INFO: `/v3/projects/a2239ba1aa154ce6b35c0954111d6a4a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:03.913329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2239ba1aa154ce6b35c0954111d6a4a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:03.915543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:03.973452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2239ba1aa154ce6b35c0954111d6a4a', 'request_id': 'req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:03.982598 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2239ba1aa154ce6b35c0954111d6a4a', 'request_id': 'req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:03.996618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2239ba1aa154ce6b35c0954111d6a4a', 'request_id': 'req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.011824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] The token cache is being invalidate because project a2239ba1aa154ce6b35c0954111d6a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:04.012072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.015152 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.020191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1353/2691] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:03 2022] DELETE /identity/v3/projects/a2239ba1aa154ce6b35c0954111d6a4a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:04.021574 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13de460-c6c5-4334-924a-cb0ab6914fba service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:04.040601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13de460-c6c5-4334-924a-cb0ab6914fba service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:04.049985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:04.110650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:04.111567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:04.111844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:04.112115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] PATH_INFO: `/v3/users/69de3ac7bd9a4c8cb518b2131224964f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:04.113347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69de3ac7bd9a4c8cb518b2131224964f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:04.115358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:04.170596 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69de3ac7bd9a4c8cb518b2131224964f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.184844 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69de3ac7bd9a4c8cb518b2131224964f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.185590 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69de3ac7bd9a4c8cb518b2131224964f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.194117 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69de3ac7bd9a4c8cb518b2131224964f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.194908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a5e4bcd8-dd4c-4a35-9f48-ce4b8b7a9da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69de3ac7bd9a4c8cb518b2131224964f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.216630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1339/2692] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:04 2022] DELETE /identity/v3/users/69de3ac7bd9a4c8cb518b2131224964f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:04.519788 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:04.521750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:04.548917 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f9ce1-7ee5-48c7-83e8-7e0ed6d6e9c0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:04.623160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:04.624045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:04.624670 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:04.624978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] PATH_INFO: `/v3/projects/8207d3292dc64cf88e6b138e9b3f9e6a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:04.626203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8207d3292dc64cf88e6b138e9b3f9e6a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:04.628155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:04.675269 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8207d3292dc64cf88e6b138e9b3f9e6a', 'request_id': 'req-5b3a0966-0080-4f75-a3b4-a722b24351b0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.684867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8207d3292dc64cf88e6b138e9b3f9e6a', 'request_id': 'req-5b3a0966-0080-4f75-a3b4-a722b24351b0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.694175 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8207d3292dc64cf88e6b138e9b3f9e6a', 'request_id': 'req-5b3a0966-0080-4f75-a3b4-a722b24351b0'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.702767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:04.709998 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] The token cache is being invalidate because project 8207d3292dc64cf88e6b138e9b3f9e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:04.710591 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.712824 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-5b3a0966-0080-4f75-a3b4-a722b24351b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:04.715213 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1354/2693] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:04 2022] DELETE /identity/v3/projects/8207d3292dc64cf88e6b138e9b3f9e6a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:04.719874 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa0897-907a-4878-bcb8-ffcd297c7cc4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:04.720592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa0897-907a-4878-bcb8-ffcd297c7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:04.721173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa0897-907a-4878-bcb8-ffcd297c7cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:04.740806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b9aa0897-907a-4878-bcb8-ffcd297c7cc4 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:04.742125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b9aa0897-907a-4878-bcb8-ffcd297c7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:04.811033 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1340/2694] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:04.823070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d72f-543d-47fd-b4bc-5b8620718683 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:04.823070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d72f-543d-47fd-b4bc-5b8620718683 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:04.823070 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d72f-543d-47fd-b4bc-5b8620718683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:04.845766 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2ca3d72f-543d-47fd-b4bc-5b8620718683 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:04.848470 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2ca3d72f-543d-47fd-b4bc-5b8620718683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:04.861312 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1355/2695] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:04.862597 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa0897-907a-4878-bcb8-ffcd297c7cc4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:04.872877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa0897-907a-4878-bcb8-ffcd297c7cc4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:04.878125 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:04.878811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:04.879119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:04.879387 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:04.880175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:38:04.880422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:04.882306 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:04.895256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1341/2696] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:38:04.899822 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3d72f-543d-47fd-b4bc-5b8620718683 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:04.909705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3d72f-543d-47fd-b4bc-5b8620718683 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:04.914493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea48a9-5614-4a90-9ad9-a464f12d8f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:04.915310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea48a9-5614-4a90-9ad9-a464f12d8f1d admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:04.915703 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea48a9-5614-4a90-9ad9-a464f12d8f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:04.915976 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea48a9-5614-4a90-9ad9-a464f12d8f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:04.916667 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea48a9-5614-4a90-9ad9-a464f12d8f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:04.923613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea48a9-5614-4a90-9ad9-a464f12d8f1d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:04.955994 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1356/2697] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:04 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:04.960455 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:04.971192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6c5bc-c6df-4a15-9622-7b7da4f11dd0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:04.987090 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:05.041509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485afaf-2c71-4f6a-84bd-93c8f5ab4edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.042384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485afaf-2c71-4f6a-84bd-93c8f5ab4edd admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.042730 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485afaf-2c71-4f6a-84bd-93c8f5ab4edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.043185 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485afaf-2c71-4f6a-84bd-93c8f5ab4edd admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.044036 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485afaf-2c71-4f6a-84bd-93c8f5ab4edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.045983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485afaf-2c71-4f6a-84bd-93c8f5ab4edd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.073970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1342/2698] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:04 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:38:05.075404 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea48a9-5614-4a90-9ad9-a464f12d8f1d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.089600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea48a9-5614-4a90-9ad9-a464f12d8f1d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.095108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f9b97-c605-4b09-a141-99a672b7c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.095854 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f9b97-c605-4b09-a141-99a672b7c859 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.096074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f9b97-c605-4b09-a141-99a672b7c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.096342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f9b97-c605-4b09-a141-99a672b7c859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.097073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f9b97-c605-4b09-a141-99a672b7c859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.098794 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f9b97-c605-4b09-a141-99a672b7c859 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.111200 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1357/2699] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:05.115481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485afaf-2c71-4f6a-84bd-93c8f5ab4edd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.126226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485afaf-2c71-4f6a-84bd-93c8f5ab4edd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.133763 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7afda-465b-4e16-a671-ef2fb0e19db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.135421 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7afda-465b-4e16-a671-ef2fb0e19db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.136052 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7afda-465b-4e16-a671-ef2fb0e19db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.136979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7afda-465b-4e16-a671-ef2fb0e19db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.137512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7afda-465b-4e16-a671-ef2fb0e19db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.140057 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7afda-465b-4e16-a671-ef2fb0e19db7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.157816 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1343/2700] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:05.160155 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f9b97-c605-4b09-a141-99a672b7c859 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.172720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f9b97-c605-4b09-a141-99a672b7c859 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.177919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29b36e-0b4a-4a93-aec2-154bfb3e4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.178925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b36e-0b4a-4a93-aec2-154bfb3e4f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.179242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b36e-0b4a-4a93-aec2-154bfb3e4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.179512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29b36e-0b4a-4a93-aec2-154bfb3e4f11 admin admin] PATH_INFO: `/v3/projects/7c0fb98437e24bbebaa811e27247aeb8/users/98f2a7c45a5b4caf9db3400c65b84b43/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.198322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29b36e-0b4a-4a93-aec2-154bfb3e4f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0fb98437e24bbebaa811e27247aeb8, user_id=98f2a7c45a5b4caf9db3400c65b84b43, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.201607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29b36e-0b4a-4a93-aec2-154bfb3e4f11 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.219311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1358/2701] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:05 2022] PUT /identity/v3/projects/7c0fb98437e24bbebaa811e27247aeb8/users/98f2a7c45a5b4caf9db3400c65b84b43/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:05.232248 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e44f-bd82-465c-974c-8ac1e0c4c0f8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.233670 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e44f-bd82-465c-974c-8ac1e0c4c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.234232 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e44f-bd82-465c-974c-8ac1e0c4c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.270112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8805e44f-bd82-465c-974c-8ac1e0c4c0f8 None None] MFA Rules not processed for user `98f2a7c45a5b4caf9db3400c65b84b43`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:05.271430 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8805e44f-bd82-465c-974c-8ac1e0c4c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:05.362865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1344/2702] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:05.364425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29b36e-0b4a-4a93-aec2-154bfb3e4f11 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.428100 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29b36e-0b4a-4a93-aec2-154bfb3e4f11 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.437578 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beddd4-0beb-49bc-b438-9971c15e57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.438499 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beddd4-0beb-49bc-b438-9971c15e57e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.438846 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beddd4-0beb-49bc-b438-9971c15e57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.439082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beddd4-0beb-49bc-b438-9971c15e57e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.439848 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42beddd4-0beb-49bc-b438-9971c15e57e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.441857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42beddd4-0beb-49bc-b438-9971c15e57e7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.477437 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1359/2703] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:05 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:05.481972 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805e44f-bd82-465c-974c-8ac1e0c4c0f8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.493100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805e44f-bd82-465c-974c-8ac1e0c4c0f8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.553917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ecaf7-fec3-4614-bd7a-6c431ae42d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.554637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ecaf7-fec3-4614-bd7a-6c431ae42d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.554917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ecaf7-fec3-4614-bd7a-6c431ae42d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.555255 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ecaf7-fec3-4614-bd7a-6c431ae42d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.555967 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ecaf7-fec3-4614-bd7a-6c431ae42d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.558058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ecaf7-fec3-4614-bd7a-6c431ae42d05 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.604713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1345/2704] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:05 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:38:05.608709 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beddd4-0beb-49bc-b438-9971c15e57e7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.625839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beddd4-0beb-49bc-b438-9971c15e57e7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.631362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d527f-2316-45c0-aaf5-a9d0ddca42c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.632150 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d527f-2316-45c0-aaf5-a9d0ddca42c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.632383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d527f-2316-45c0-aaf5-a9d0ddca42c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.632611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d527f-2316-45c0-aaf5-a9d0ddca42c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.633520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d527f-2316-45c0-aaf5-a9d0ddca42c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.635257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d527f-2316-45c0-aaf5-a9d0ddca42c7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.647438 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1360/2705] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:05.652123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ecaf7-fec3-4614-bd7a-6c431ae42d05 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.662191 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ecaf7-fec3-4614-bd7a-6c431ae42d05 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.668524 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce559-1cf8-406a-9a03-3ebb74c28276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.669420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce559-1cf8-406a-9a03-3ebb74c28276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.669702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce559-1cf8-406a-9a03-3ebb74c28276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.669977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce559-1cf8-406a-9a03-3ebb74c28276 admin admin] PATH_INFO: `/v3/projects/76a1a2f7e95943b890a82d63fc98b9a7/users/7a815a5cbfc549a89918bd5befa9ecac/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.684080 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:05.688223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ce559-1cf8-406a-9a03-3ebb74c28276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a1a2f7e95943b890a82d63fc98b9a7, user_id=7a815a5cbfc549a89918bd5befa9ecac, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.691066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ce559-1cf8-406a-9a03-3ebb74c28276 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.713113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1346/2706] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:05 2022] PUT /identity/v3/projects/76a1a2f7e95943b890a82d63fc98b9a7/users/7a815a5cbfc549a89918bd5befa9ecac/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:05.717097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d527f-2316-45c0-aaf5-a9d0ddca42c7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.744358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d527f-2316-45c0-aaf5-a9d0ddca42c7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.805795 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa4bc2-af6e-4a0b-bd29-474b7a34eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.806464 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa4bc2-af6e-4a0b-bd29-474b7a34eef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.806741 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa4bc2-af6e-4a0b-bd29-474b7a34eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.807057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa4bc2-af6e-4a0b-bd29-474b7a34eef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.807890 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa4bc2-af6e-4a0b-bd29-474b7a34eef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.809510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa4bc2-af6e-4a0b-bd29-474b7a34eef5 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.825767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce559-1cf8-406a-9a03-3ebb74c28276 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:05.837224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1361/2707] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:05.840547 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce559-1cf8-406a-9a03-3ebb74c28276 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:05.845495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:05.846416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.846689 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.846993 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] PATH_INFO: `/v3/projects/76a1a2f7e95943b890a82d63fc98b9a7/users/7a815a5cbfc549a89918bd5befa9ecac/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.849176 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a1a2f7e95943b890a82d63fc98b9a7, user_id=7a815a5cbfc549a89918bd5befa9ecac, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:05.852025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:05.864077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1347/2708] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:05 2022] PUT /identity/v3/projects/76a1a2f7e95943b890a82d63fc98b9a7/users/7a815a5cbfc549a89918bd5befa9ecac/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:05.874901 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5c95-4fc9-4bb8-bef0-cc9572eebf74 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:05.875215 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5c95-4fc9-4bb8-bef0-cc9572eebf74 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:05.875494 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5c95-4fc9-4bb8-bef0-cc9572eebf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:05.883806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:05.907163 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-029f5c95-4fc9-4bb8-bef0-cc9572eebf74 None None] MFA Rules not processed for user `7a815a5cbfc549a89918bd5befa9ecac`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:05.908585 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-029f5c95-4fc9-4bb8-bef0-cc9572eebf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:05.987239 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1362/2709] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:05.998881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:06.001286 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:06.061208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3efb2-2c6b-42d0-94be-af812aa8d8f9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:06.065654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72275b21-adda-428e-89ab-5371b8314b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:06.066304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275b21-adda-428e-89ab-5371b8314b05 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:06.066566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275b21-adda-428e-89ab-5371b8314b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:06.066833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275b21-adda-428e-89ab-5371b8314b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:06.090188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72275b21-adda-428e-89ab-5371b8314b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:06.091835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72275b21-adda-428e-89ab-5371b8314b05 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:06.104740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1348/2710] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:06.195423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5c95-4fc9-4bb8-bef0-cc9572eebf74 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:06.209978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5c95-4fc9-4bb8-bef0-cc9572eebf74 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:06.214416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b4898-1992-4fe9-a62c-955cd575a77d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:06.215141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4898-1992-4fe9-a62c-955cd575a77d service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:06.215426 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4898-1992-4fe9-a62c-955cd575a77d service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:06.215698 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4898-1992-4fe9-a62c-955cd575a77d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:06.306705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b4898-1992-4fe9-a62c-955cd575a77d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:06.308199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b4898-1992-4fe9-a62c-955cd575a77d service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:06.317310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1363/2711] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:11.276826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72275b21-adda-428e-89ab-5371b8314b05 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:11.345755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72275b21-adda-428e-89ab-5371b8314b05 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:11.350070 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:11.351551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:11.351830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:11.352102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] PATH_INFO: `/v3/users/98f2a7c45a5b4caf9db3400c65b84b43` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:11.353294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f2a7c45a5b4caf9db3400c65b84b43)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:11.355256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:11.407375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f2a7c45a5b4caf9db3400c65b84b43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:11.421242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f2a7c45a5b4caf9db3400c65b84b43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:11.422079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f2a7c45a5b4caf9db3400c65b84b43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:11.429420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f2a7c45a5b4caf9db3400c65b84b43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:11.430134 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f2a7c45a5b4caf9db3400c65b84b43'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:11.439019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:11.453841 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1349/2712] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:11 2022] DELETE /identity/v3/users/98f2a7c45a5b4caf9db3400c65b84b43 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:11.458540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666d15-6af2-4ae5-b157-fbd3a1c2f812 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:11.459137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666d15-6af2-4ae5-b157-fbd3a1c2f812 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:11.459137 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666d15-6af2-4ae5-b157-fbd3a1c2f812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:11.480072 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-45666d15-6af2-4ae5-b157-fbd3a1c2f812 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:11.481295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-45666d15-6af2-4ae5-b157-fbd3a1c2f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:11.555828 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1364/2713] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:11.565729 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:11.567300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:11.625747 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ba8a3-9933-4ae6-be41-42a6995b1776 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:11.630713 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a334e78-251b-448b-9baf-4b38f93f99d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:11.631416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334e78-251b-448b-9baf-4b38f93f99d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:11.631694 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334e78-251b-448b-9baf-4b38f93f99d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:11.631958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a334e78-251b-448b-9baf-4b38f93f99d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:11.642857 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a334e78-251b-448b-9baf-4b38f93f99d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:11.644336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a334e78-251b-448b-9baf-4b38f93f99d9 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:11.654463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1350/2714] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:11.950632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666d15-6af2-4ae5-b157-fbd3a1c2f812 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:11.955147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-45666d15-6af2-4ae5-b157-fbd3a1c2f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:11.970883 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666d15-6af2-4ae5-b157-fbd3a1c2f812 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:11.976978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:11.977951 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:11.978307 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:11.978659 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] PATH_INFO: `/v3/projects/7c0fb98437e24bbebaa811e27247aeb8` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:11.980117 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0fb98437e24bbebaa811e27247aeb8)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:11.982227 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:12.008218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:12.031954 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0fb98437e24bbebaa811e27247aeb8', 'request_id': 'req-0af90f37-8155-4784-b5fb-6d970ca2410f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.042445 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0fb98437e24bbebaa811e27247aeb8', 'request_id': 'req-0af90f37-8155-4784-b5fb-6d970ca2410f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.048452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0fb98437e24bbebaa811e27247aeb8', 'request_id': 'req-0af90f37-8155-4784-b5fb-6d970ca2410f'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.063028 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] The token cache is being invalidate because project 7c0fb98437e24bbebaa811e27247aeb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:12.063428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.064091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.065656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1365/2715] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:11 2022] DELETE /identity/v3/projects/7c0fb98437e24bbebaa811e27247aeb8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:12.069961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a334e78-251b-448b-9baf-4b38f93f99d9 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:12.079704 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a334e78-251b-448b-9baf-4b38f93f99d9 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:12.135237 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:12.136126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:12.136410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:12.136687 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] PATH_INFO: `/v3/users/7a815a5cbfc549a89918bd5befa9ecac` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:12.137875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a815a5cbfc549a89918bd5befa9ecac)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:12.139845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:12.189025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a815a5cbfc549a89918bd5befa9ecac'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.201473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a815a5cbfc549a89918bd5befa9ecac'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.202133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a815a5cbfc549a89918bd5befa9ecac'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.209470 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a815a5cbfc549a89918bd5befa9ecac'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.210165 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0b809c3a-5df0-4233-81f4-a6ec74bbc832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a815a5cbfc549a89918bd5befa9ecac'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.223194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1351/2716] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:12 2022] DELETE /identity/v3/users/7a815a5cbfc549a89918bd5befa9ecac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:12.586777 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:12.588254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:12.602065 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af90f37-8155-4784-b5fb-6d970ca2410f admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:12.661354 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:12.662248 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:12.662530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:12.662789 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] PATH_INFO: `/v3/projects/76a1a2f7e95943b890a82d63fc98b9a7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:12.664103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a1a2f7e95943b890a82d63fc98b9a7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:12.666093 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:12.713720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a1a2f7e95943b890a82d63fc98b9a7', 'request_id': 'req-53e1ece7-b3d2-4647-ae78-7c04915a05d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.722452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a1a2f7e95943b890a82d63fc98b9a7', 'request_id': 'req-53e1ece7-b3d2-4647-ae78-7c04915a05d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.729052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a1a2f7e95943b890a82d63fc98b9a7', 'request_id': 'req-53e1ece7-b3d2-4647-ae78-7c04915a05d2'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.741204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] The token cache is being invalidate because project 76a1a2f7e95943b890a82d63fc98b9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:12.741489 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.742149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-53e1ece7-b3d2-4647-ae78-7c04915a05d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:12.743882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1366/2717] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:12 2022] DELETE /identity/v3/projects/76a1a2f7e95943b890a82d63fc98b9a7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:12.748793 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebdc7-7b08-4c68-b8bf-8dfa5a2a2494 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:12.749613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebdc7-7b08-4c68-b8bf-8dfa5a2a2494 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:12.749722 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebdc7-7b08-4c68-b8bf-8dfa5a2a2494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:12.770929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4b8ebdc7-7b08-4c68-b8bf-8dfa5a2a2494 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:12.772658 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4b8ebdc7-7b08-4c68-b8bf-8dfa5a2a2494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:12.794652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:12.845067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1352/2718] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:12.854046 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff09e37-8c3b-435c-81ca-9702cb9f2b7d None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:12.854336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff09e37-8c3b-435c-81ca-9702cb9f2b7d None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:12.854615 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff09e37-8c3b-435c-81ca-9702cb9f2b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:12.876023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4ff09e37-8c3b-435c-81ca-9702cb9f2b7d None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:12.877277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ff09e37-8c3b-435c-81ca-9702cb9f2b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:12.887007 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1367/2719] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:12.891527 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ebdc7-7b08-4c68-b8bf-8dfa5a2a2494 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:12.902087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ebdc7-7b08-4c68-b8bf-8dfa5a2a2494 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:12.907386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:12.908056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:12.908338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:12.908615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:12.909345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:38:12.909652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:12.911295 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:12.923942 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1353/2720] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:38:12.928432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff09e37-8c3b-435c-81ca-9702cb9f2b7d None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:12.937956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff09e37-8c3b-435c-81ca-9702cb9f2b7d None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:12.943770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b92b7-4b0e-4aa9-a5ce-1753c153f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:12.944516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b92b7-4b0e-4aa9-a5ce-1753c153f6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:12.944803 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b92b7-4b0e-4aa9-a5ce-1753c153f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:12.945068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b92b7-4b0e-4aa9-a5ce-1753c153f6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:12.945780 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b92b7-4b0e-4aa9-a5ce-1753c153f6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:12.947813 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b92b7-4b0e-4aa9-a5ce-1753c153f6a7 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:12.975252 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1368/2721] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:12 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:12.979705 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:12.992256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a865-d89c-457f-a36c-e45a6b18de64 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:13.055566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560837f3-c17e-4056-95e0-80599d9ec450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:13.056161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560837f3-c17e-4056-95e0-80599d9ec450 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:13.056441 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560837f3-c17e-4056-95e0-80599d9ec450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:13.056712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560837f3-c17e-4056-95e0-80599d9ec450 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:13.057419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560837f3-c17e-4056-95e0-80599d9ec450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:13.059420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560837f3-c17e-4056-95e0-80599d9ec450 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:13.083678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1354/2722] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:12 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:38:13.088230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b92b7-4b0e-4aa9-a5ce-1753c153f6a7 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:13.099203 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b92b7-4b0e-4aa9-a5ce-1753c153f6a7 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:13.105020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054bb0f-8578-4566-bc1e-4367d879fb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:13.105717 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054bb0f-8578-4566-bc1e-4367d879fb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:13.106002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054bb0f-8578-4566-bc1e-4367d879fb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:13.106274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054bb0f-8578-4566-bc1e-4367d879fb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:13.107051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054bb0f-8578-4566-bc1e-4367d879fb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:13.108681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054bb0f-8578-4566-bc1e-4367d879fb9d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:13.121078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1369/2723] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:13.127643 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560837f3-c17e-4056-95e0-80599d9ec450 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:13.138869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560837f3-c17e-4056-95e0-80599d9ec450 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:13.149146 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7baa-53bc-4b76-ae46-b885e4708531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:13.150491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7baa-53bc-4b76-ae46-b885e4708531 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:13.151714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7baa-53bc-4b76-ae46-b885e4708531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:13.152002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7baa-53bc-4b76-ae46-b885e4708531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:13.152745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad7baa-53bc-4b76-ae46-b885e4708531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:13.154373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad7baa-53bc-4b76-ae46-b885e4708531 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:13.165877 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1355/2724] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:13.170295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054bb0f-8578-4566-bc1e-4367d879fb9d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:13.175761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:13.181415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054bb0f-8578-4566-bc1e-4367d879fb9d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:13.188364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:13.189286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:13.189888 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:13.190330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] PATH_INFO: `/v3/projects/75847559871b49ad99a43e6d214651d5/users/7b7256e2f3a54d678aa4887e0f59d44e/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:13.205705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75847559871b49ad99a43e6d214651d5, user_id=7b7256e2f3a54d678aa4887e0f59d44e, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:13.208443 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:13.223925 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1370/2725] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:13 2022] PUT /identity/v3/projects/75847559871b49ad99a43e6d214651d5/users/7b7256e2f3a54d678aa4887e0f59d44e/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:13.229207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15a92a-466d-4d00-9069-fa66c4ed45e6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:13.229494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15a92a-466d-4d00-9069-fa66c4ed45e6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:13.229774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15a92a-466d-4d00-9069-fa66c4ed45e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:13.247919 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1c15a92a-466d-4d00-9069-fa66c4ed45e6 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:13.249145 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c15a92a-466d-4d00-9069-fa66c4ed45e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:13.312669 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1356/2726] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:13.322074 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:13.323902 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:13.393375 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e8388-bd3c-4e63-bef7-2b6d19d6f32b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:13.399344 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:13.400261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:13.400684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:13.401207 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:13.413721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:13.415295 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:13.425892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1371/2727] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:14.109937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d25e28-8741-4348-8773-d80a27a90ba9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:14.110592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d25e28-8741-4348-8773-d80a27a90ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:14.110742 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d25e28-8741-4348-8773-d80a27a90ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:14.144340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-38d25e28-8741-4348-8773-d80a27a90ba9 None None] MFA Rules not processed for user `7b7256e2f3a54d678aa4887e0f59d44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:14.145696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-38d25e28-8741-4348-8773-d80a27a90ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:14.165634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:14.230064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1357/2728] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:14.242683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:14.244596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:14.325226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d2e0-1740-453c-958b-d8cf84aed504 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:14.329042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:14.329932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:14.330217 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:14.330493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:14.343466 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:14.344949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:14.359488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1372/2729] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:14.818860 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eea4c4-5d08-4244-9a81-0862485dc34d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:14.819231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eea4c4-5d08-4244-9a81-0862485dc34d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:14.819656 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eea4c4-5d08-4244-9a81-0862485dc34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:14.840065 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b5eea4c4-5d08-4244-9a81-0862485dc34d None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:14.841277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b5eea4c4-5d08-4244-9a81-0862485dc34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:14.906172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1358/2730] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jul 20 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:14.919280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:14.920731 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:14.996607 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21d40-8267-4539-9bdd-26b04bb5363d service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:15.002406 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616f1a3-692c-4ecb-b50b-ed34cf49bae7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:15.003108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f1a3-692c-4ecb-b50b-ed34cf49bae7 service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:15.003387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f1a3-692c-4ecb-b50b-ed34cf49bae7 service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:15.003686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f1a3-692c-4ecb-b50b-ed34cf49bae7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:15.012631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616f1a3-692c-4ecb-b50b-ed34cf49bae7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:15.014336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616f1a3-692c-4ecb-b50b-ed34cf49bae7 service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:15.024810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1373/2731] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:38:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:38:15.745119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c746f-1a4c-4dc4-a314-5b118712e133 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:15.745707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c746f-1a4c-4dc4-a314-5b118712e133 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:15.745707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c746f-1a4c-4dc4-a314-5b118712e133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:15.765432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-048c746f-1a4c-4dc4-a314-5b118712e133 None None] MFA Rules not processed for user `7b7256e2f3a54d678aa4887e0f59d44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:15.766668 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-048c746f-1a4c-4dc4-a314-5b118712e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:15.775827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1359/2732] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:25.019974 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:25.759813 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=47 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:30.132939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4fd1-51fb-45ee-a0cd-e89204241b40 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:30.133829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4fd1-51fb-45ee-a0cd-e89204241b40 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:30.133829 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4fd1-51fb-45ee-a0cd-e89204241b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:30.154236 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-026a4fd1-51fb-45ee-a0cd-e89204241b40 None None] MFA Rules not processed for user `7b7256e2f3a54d678aa4887e0f59d44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:30.155672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-026a4fd1-51fb-45ee-a0cd-e89204241b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:30.167996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1374/2733] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:34.339459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c746f-1a4c-4dc4-a314-5b118712e133 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:34.341118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-048c746f-1a4c-4dc4-a314-5b118712e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:34.354087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c746f-1a4c-4dc4-a314-5b118712e133 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:34.358089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9514bb-9764-4b5d-a192-422509667014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:34.358755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9514bb-9764-4b5d-a192-422509667014 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:34.359077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9514bb-9764-4b5d-a192-422509667014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:34.359478 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9514bb-9764-4b5d-a192-422509667014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:34.361391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1b9514bb-9764-4b5d-a192-422509667014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:34.450018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9514bb-9764-4b5d-a192-422509667014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:34.452598 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9514bb-9764-4b5d-a192-422509667014 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:34.488541 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1360/2734] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:35.687638 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4fd1-51fb-45ee-a0cd-e89204241b40 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:35.702858 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4fd1-51fb-45ee-a0cd-e89204241b40 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:35.708197 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:35.708948 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:35.709234 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:35.709504 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:35.711734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:35.732702 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:35.734184 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:35.753023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1375/2735] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:44.484142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=43 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:45.258715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041c92b-43df-4a79-a6c5-521c6f7761f6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:45.259026 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041c92b-43df-4a79-a6c5-521c6f7761f6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:45.259307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041c92b-43df-4a79-a6c5-521c6f7761f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:45.278616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0041c92b-43df-4a79-a6c5-521c6f7761f6 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:45.280089 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0041c92b-43df-4a79-a6c5-521c6f7761f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:45.287880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1361/2736] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:45.310932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:45.322910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9625a-d7af-45fd-bd1b-bd39d48d1c56 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:45.329293 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4df43-3ec0-434e-87eb-d3e6cfacc2bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:45.329956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4df43-3ec0-434e-87eb-d3e6cfacc2bf service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:45.330242 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4df43-3ec0-434e-87eb-d3e6cfacc2bf service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:45.330520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4df43-3ec0-434e-87eb-d3e6cfacc2bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:45.339486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4df43-3ec0-434e-87eb-d3e6cfacc2bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:45.341101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4df43-3ec0-434e-87eb-d3e6cfacc2bf service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:45.349310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1376/2737] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:38:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:38:55.272123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:55.346130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=15 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:59.322696 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041c92b-43df-4a79-a6c5-521c6f7761f6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:59.334790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041c92b-43df-4a79-a6c5-521c6f7761f6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:59.337907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:59.338759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:59.339204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:59.339589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:59.341996 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:59.360570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:59.362199 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:59.380571 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1362/2738] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:01.200006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9fab4-f3ed-45d4-b539-c747c01868b1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:01.200893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9fab4-f3ed-45d4-b539-c747c01868b1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:01.200893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9fab4-f3ed-45d4-b539-c747c01868b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:01.290045 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-4bb9fab4-f3ed-45d4-b539-c747c01868b1 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:01.292397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4bb9fab4-f3ed-45d4-b539-c747c01868b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:01.323989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1377/2739] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jul 20 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:01.339944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:01.368436 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bb9e7-bc6d-4ff0-be32-730c3ed0c6e6 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:01.374866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ad7d-0ecc-4579-8c3d-6bfa904b1bb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:01.375858 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ad7d-0ecc-4579-8c3d-6bfa904b1bb2 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:01.376323 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ad7d-0ecc-4579-8c3d-6bfa904b1bb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:01.376736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ad7d-0ecc-4579-8c3d-6bfa904b1bb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:01.386320 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2ad7d-0ecc-4579-8c3d-6bfa904b1bb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:01.388270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2ad7d-0ecc-4579-8c3d-6bfa904b1bb2 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:01.399515 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1363/2740] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:39:01.617164 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9fab4-f3ed-45d4-b539-c747c01868b1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:01.619087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4bb9fab4-f3ed-45d4-b539-c747c01868b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:01.639742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9fab4-f3ed-45d4-b539-c747c01868b1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:01.644745 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:01.645641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:01.645926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:01.646251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] PATH_INFO: `/v3/users/a5e1a82a4acf48c5a82c381e50bbe408` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:01.647630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e1a82a4acf48c5a82c381e50bbe408)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:01.649617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:01.709920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e1a82a4acf48c5a82c381e50bbe408'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:01.724428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e1a82a4acf48c5a82c381e50bbe408'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:01.725479 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e1a82a4acf48c5a82c381e50bbe408'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:01.726637 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e1a82a4acf48c5a82c381e50bbe408'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:01.734844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-7ce1ba9f-1bf8-4129-b756-3546a95e5c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e1a82a4acf48c5a82c381e50bbe408'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:01.755436 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1378/2741] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:01 2022] DELETE /identity/v3/users/a5e1a82a4acf48c5a82c381e50bbe408 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:01.981180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ad7d-0ecc-4579-8c3d-6bfa904b1bb2 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:01.995862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ad7d-0ecc-4579-8c3d-6bfa904b1bb2 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.071301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.072179 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.072458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.072726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] PATH_INFO: `/v3/projects/40c952d0938b4ca8969139b924473261` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.073916 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c952d0938b4ca8969139b924473261)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.075880 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:02.128879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c952d0938b4ca8969139b924473261', 'request_id': 'req-00b22387-ed4e-4a06-a594-14247589300a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:02.137410 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c952d0938b4ca8969139b924473261', 'request_id': 'req-00b22387-ed4e-4a06-a594-14247589300a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:02.146315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c952d0938b4ca8969139b924473261', 'request_id': 'req-00b22387-ed4e-4a06-a594-14247589300a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:02.165536 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] The token cache is being invalidate because project 40c952d0938b4ca8969139b924473261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:02.166022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:02.167103 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-00b22387-ed4e-4a06-a594-14247589300a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:02.169717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1364/2742] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:01 2022] DELETE /identity/v3/projects/40c952d0938b4ca8969139b924473261 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:02.176713 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf887-2120-43b7-8772-2ddffd832068 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.176996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf887-2120-43b7-8772-2ddffd832068 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.177267 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf887-2120-43b7-8772-2ddffd832068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.196706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-b08bf887-2120-43b7-8772-2ddffd832068 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:02.197921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-b08bf887-2120-43b7-8772-2ddffd832068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:02.260875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1379/2743] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:02.274892 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359c24b-f10f-4623-8f1f-e7f74ecd0f10 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.275113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359c24b-f10f-4623-8f1f-e7f74ecd0f10 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.275401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359c24b-f10f-4623-8f1f-e7f74ecd0f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.297259 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2359c24b-f10f-4623-8f1f-e7f74ecd0f10 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:02.298570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2359c24b-f10f-4623-8f1f-e7f74ecd0f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:02.309023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1365/2744] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:02.313875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf887-2120-43b7-8772-2ddffd832068 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:02.325349 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf887-2120-43b7-8772-2ddffd832068 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.331151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.332003 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.332341 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.332649 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.333571 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:02.333967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.336230 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:02.352120 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1380/2745] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:39:02.357172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359c24b-f10f-4623-8f1f-e7f74ecd0f10 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:02.368008 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359c24b-f10f-4623-8f1f-e7f74ecd0f10 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.372645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e1003-3144-44af-871a-4765f873fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.373313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e1003-3144-44af-871a-4765f873fffe admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.373589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e1003-3144-44af-871a-4765f873fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.373856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e1003-3144-44af-871a-4765f873fffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.374951 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e1003-3144-44af-871a-4765f873fffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.377334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e1003-3144-44af-871a-4765f873fffe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:02.417156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1366/2746] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:02 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:39:02.421190 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:02.432226 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847ddea-8922-4755-a1f6-c8facc4716cf admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.453677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:02.499767 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee781-1aba-4fbf-bb6c-66f36b529d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.500457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee781-1aba-4fbf-bb6c-66f36b529d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.500740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee781-1aba-4fbf-bb6c-66f36b529d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.501020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee781-1aba-4fbf-bb6c-66f36b529d41 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.501728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee781-1aba-4fbf-bb6c-66f36b529d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.503758 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee781-1aba-4fbf-bb6c-66f36b529d41 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:02.525691 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1381/2747] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:02 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:02.530161 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e1003-3144-44af-871a-4765f873fffe admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:02.541779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e1003-3144-44af-871a-4765f873fffe admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.547048 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f9fe1-4d53-46cd-92a1-8cdc454a87d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.547792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f9fe1-4d53-46cd-92a1-8cdc454a87d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.548186 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f9fe1-4d53-46cd-92a1-8cdc454a87d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.548456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f9fe1-4d53-46cd-92a1-8cdc454a87d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.549307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f9fe1-4d53-46cd-92a1-8cdc454a87d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.551195 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f9fe1-4d53-46cd-92a1-8cdc454a87d7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:02.562267 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1367/2748] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:02.566590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee781-1aba-4fbf-bb6c-66f36b529d41 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:02.577394 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee781-1aba-4fbf-bb6c-66f36b529d41 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.582509 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147bc1b-45dc-47e6-97f5-297c4c7cfee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.583218 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147bc1b-45dc-47e6-97f5-297c4c7cfee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.583507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147bc1b-45dc-47e6-97f5-297c4c7cfee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.583786 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147bc1b-45dc-47e6-97f5-297c4c7cfee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.584631 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147bc1b-45dc-47e6-97f5-297c4c7cfee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.586288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147bc1b-45dc-47e6-97f5-297c4c7cfee4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:02.596810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1382/2749] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:02.601231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f9fe1-4d53-46cd-92a1-8cdc454a87d7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:02.612266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f9fe1-4d53-46cd-92a1-8cdc454a87d7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.617472 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbfaac-d02b-44ea-8bdc-e55b069735e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.618420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbfaac-d02b-44ea-8bdc-e55b069735e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.618702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbfaac-d02b-44ea-8bdc-e55b069735e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.618998 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbfaac-d02b-44ea-8bdc-e55b069735e1 admin admin] PATH_INFO: `/v3/projects/d4b5bab9f53f408c9ecf3acd79986576/users/5bc713f3f1984c5bbfe2f341715edd12/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.621450 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:02.637823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbfaac-d02b-44ea-8bdc-e55b069735e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b5bab9f53f408c9ecf3acd79986576, user_id=5bc713f3f1984c5bbfe2f341715edd12, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.640552 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbfaac-d02b-44ea-8bdc-e55b069735e1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:02.656717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1368/2750] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:02 2022] PUT /identity/v3/projects/d4b5bab9f53f408c9ecf3acd79986576/users/5bc713f3f1984c5bbfe2f341715edd12/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:02.667301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05772-c71b-4217-84af-c100234c3c1a None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.667597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05772-c71b-4217-84af-c100234c3c1a None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.667872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05772-c71b-4217-84af-c100234c3c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.702195 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-62d05772-c71b-4217-84af-c100234c3c1a None None] MFA Rules not processed for user `5bc713f3f1984c5bbfe2f341715edd12`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:02.703463 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-62d05772-c71b-4217-84af-c100234c3c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:02.771512 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1383/2751] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:02.776399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbfaac-d02b-44ea-8bdc-e55b069735e1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:02.857845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbfaac-d02b-44ea-8bdc-e55b069735e1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.862985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e0b-d1b4-41b1-8a4d-e49801cd6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.863667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e0b-d1b4-41b1-8a4d-e49801cd6ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.863946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e0b-d1b4-41b1-8a4d-e49801cd6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.864226 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e0b-d1b4-41b1-8a4d-e49801cd6ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.864939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3e0b-d1b4-41b1-8a4d-e49801cd6ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.867935 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3e0b-d1b4-41b1-8a4d-e49801cd6ceb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:02.897402 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1369/2752] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:02 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:02.902381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05772-c71b-4217-84af-c100234c3c1a None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:02.918629 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05772-c71b-4217-84af-c100234c3c1a None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:02.990073 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3b7ed-2bf5-4c70-a595-f8c401b6e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:02.990763 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3b7ed-2bf5-4c70-a595-f8c401b6e508 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:02.991078 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3b7ed-2bf5-4c70-a595-f8c401b6e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:02.991353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3b7ed-2bf5-4c70-a595-f8c401b6e508 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:02.992188 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3b7ed-2bf5-4c70-a595-f8c401b6e508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:02.994132 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3b7ed-2bf5-4c70-a595-f8c401b6e508 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.018041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1384/2753] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:02 2022] POST /identity/v3/users => generated 309 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:03.019390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e0b-d1b4-41b1-8a4d-e49801cd6ceb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.030278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e0b-d1b4-41b1-8a4d-e49801cd6ceb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:03.036038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15069-5de1-460d-84d0-0533db1a1cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:03.036840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15069-5de1-460d-84d0-0533db1a1cef admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.037219 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15069-5de1-460d-84d0-0533db1a1cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.037710 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15069-5de1-460d-84d0-0533db1a1cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.038459 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15069-5de1-460d-84d0-0533db1a1cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:03.040115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15069-5de1-460d-84d0-0533db1a1cef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.057136 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1370/2754] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:03.058864 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3b7ed-2bf5-4c70-a595-f8c401b6e508 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.071192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3b7ed-2bf5-4c70-a595-f8c401b6e508 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:03.076508 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077303a0-8eb5-463c-9f21-a1f884b552c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:03.077488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077303a0-8eb5-463c-9f21-a1f884b552c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.077779 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077303a0-8eb5-463c-9f21-a1f884b552c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.078057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077303a0-8eb5-463c-9f21-a1f884b552c4 admin admin] PATH_INFO: `/v3/projects/ce48bed9ecf945b3a80ca20948de4206/users/b57a99de93c74445b3717e43745fafba/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.094583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077303a0-8eb5-463c-9f21-a1f884b552c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce48bed9ecf945b3a80ca20948de4206, user_id=b57a99de93c74445b3717e43745fafba, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:03.097330 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077303a0-8eb5-463c-9f21-a1f884b552c4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.099729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:03.112521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1385/2755] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:03 2022] PUT /identity/v3/projects/ce48bed9ecf945b3a80ca20948de4206/users/b57a99de93c74445b3717e43745fafba/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:03.118667 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15069-5de1-460d-84d0-0533db1a1cef admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.138766 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15069-5de1-460d-84d0-0533db1a1cef admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:03.225339 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699eb5a-3b4b-4775-80e6-c971073967a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:03.226012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699eb5a-3b4b-4775-80e6-c971073967a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.226289 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699eb5a-3b4b-4775-80e6-c971073967a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.226559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699eb5a-3b4b-4775-80e6-c971073967a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.227318 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699eb5a-3b4b-4775-80e6-c971073967a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:03.229041 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699eb5a-3b4b-4775-80e6-c971073967a5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.240529 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1371/2756] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:03.245364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077303a0-8eb5-463c-9f21-a1f884b552c4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.258432 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077303a0-8eb5-463c-9f21-a1f884b552c4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:03.264094 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:03.265316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.265316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.265639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] PATH_INFO: `/v3/projects/ce48bed9ecf945b3a80ca20948de4206/users/b57a99de93c74445b3717e43745fafba/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.267729 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce48bed9ecf945b3a80ca20948de4206, user_id=b57a99de93c74445b3717e43745fafba, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:03.270414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.281739 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1386/2757] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:03 2022] PUT /identity/v3/projects/ce48bed9ecf945b3a80ca20948de4206/users/b57a99de93c74445b3717e43745fafba/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:03.292067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077f5b-1c6f-4e70-96a2-eb4d54dd38c9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.292326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077f5b-1c6f-4e70-96a2-eb4d54dd38c9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.292635 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077f5b-1c6f-4e70-96a2-eb4d54dd38c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.321937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-23077f5b-1c6f-4e70-96a2-eb4d54dd38c9 None None] MFA Rules not processed for user `b57a99de93c74445b3717e43745fafba`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:03.323241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23077f5b-1c6f-4e70-96a2-eb4d54dd38c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:03.376018 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:03.410003 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1372/2758] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:03.420867 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.422689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:03.485326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077f5b-1c6f-4e70-96a2-eb4d54dd38c9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.487649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23077f5b-1c6f-4e70-96a2-eb4d54dd38c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:03.492610 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82eeefe-835f-4406-92aa-5f0a7fc83d6b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:03.496520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9db8b-ab64-4bec-9625-9774860cb9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:03.497305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9db8b-ab64-4bec-9625-9774860cb9eb service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.497559 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9db8b-ab64-4bec-9625-9774860cb9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.497978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9db8b-ab64-4bec-9625-9774860cb9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.509679 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9db8b-ab64-4bec-9625-9774860cb9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:03.511216 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9db8b-ab64-4bec-9625-9774860cb9eb service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.521920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1387/2759] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:03 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:03.579769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077f5b-1c6f-4e70-96a2-eb4d54dd38c9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:03.585169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:03.586160 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.586581 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.586959 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] PATH_INFO: `/v3/users/7b7256e2f3a54d678aa4887e0f59d44e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.588531 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7256e2f3a54d678aa4887e0f59d44e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:03.592307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.670736 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7256e2f3a54d678aa4887e0f59d44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.685495 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7256e2f3a54d678aa4887e0f59d44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.686444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7256e2f3a54d678aa4887e0f59d44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.694498 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7256e2f3a54d678aa4887e0f59d44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.695701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8a7db7f3-86bd-4e7b-8328-0c9282fad72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7256e2f3a54d678aa4887e0f59d44e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.707950 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9db8b-ab64-4bec-9625-9774860cb9eb service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.718378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1373/2760] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:03 2022] DELETE /identity/v3/users/7b7256e2f3a54d678aa4887e0f59d44e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:03.726334 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9db8b-ab64-4bec-9625-9774860cb9eb service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:03.794718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:03.795586 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.795891 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.796170 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] PATH_INFO: `/v3/users/5bc713f3f1984c5bbfe2f341715edd12` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.797475 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc713f3f1984c5bbfe2f341715edd12)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:03.799538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.858393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc713f3f1984c5bbfe2f341715edd12'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.872516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc713f3f1984c5bbfe2f341715edd12'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.873243 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc713f3f1984c5bbfe2f341715edd12'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.873845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc713f3f1984c5bbfe2f341715edd12'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.881839 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc713f3f1984c5bbfe2f341715edd12'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.901500 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1388/2761] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:03 2022] DELETE /identity/v3/users/5bc713f3f1984c5bbfe2f341715edd12 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:03.906866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142d975-4c13-4049-9701-d0fab2c62d27 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.907223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142d975-4c13-4049-9701-d0fab2c62d27 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.907564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142d975-4c13-4049-9701-d0fab2c62d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.925529 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.926340 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c142d975-4c13-4049-9701-d0fab2c62d27 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:03.927600 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:03.928098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c142d975-4c13-4049-9701-d0fab2c62d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:03.934057 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:03.994650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:04.005820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1374/2762] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:04.015752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142d975-4c13-4049-9701-d0fab2c62d27 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.016518 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5564d-992e-4d88-9388-344dae014a12 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.017649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c142d975-4c13-4049-9701-d0fab2c62d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:04.021984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.022931 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.023245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.023520 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] PATH_INFO: `/v3/projects/75847559871b49ad99a43e6d214651d5` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.024747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75847559871b49ad99a43e6d214651d5)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.026684 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.083236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142d975-4c13-4049-9701-d0fab2c62d27 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.083467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75847559871b49ad99a43e6d214651d5', 'request_id': 'req-58d9a486-b805-4984-8235-8b6a4ea8a32c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.092483 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75847559871b49ad99a43e6d214651d5', 'request_id': 'req-58d9a486-b805-4984-8235-8b6a4ea8a32c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.098510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75847559871b49ad99a43e6d214651d5', 'request_id': 'req-58d9a486-b805-4984-8235-8b6a4ea8a32c'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.111038 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] The token cache is being invalidate because project 75847559871b49ad99a43e6d214651d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:04.111423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.112196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-58d9a486-b805-4984-8235-8b6a4ea8a32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.114016 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1389/2763] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:03 2022] DELETE /identity/v3/projects/75847559871b49ad99a43e6d214651d5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:04.121044 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18e01-0b60-4945-bb9c-9210aca9636e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.121336 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18e01-0b60-4945-bb9c-9210aca9636e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.121616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18e01-0b60-4945-bb9c-9210aca9636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.134258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cdd30-1c2e-4216-8758-9c33284d88d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.134928 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdd30-1c2e-4216-8758-9c33284d88d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.135242 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdd30-1c2e-4216-8758-9c33284d88d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.135516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdd30-1c2e-4216-8758-9c33284d88d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.137358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b56cdd30-1c2e-4216-8758-9c33284d88d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:04.141077 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3ec18e01-0b60-4945-bb9c-9210aca9636e None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:04.142277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3ec18e01-0b60-4945-bb9c-9210aca9636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:04.203644 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cdd30-1c2e-4216-8758-9c33284d88d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.205116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cdd30-1c2e-4216-8758-9c33284d88d7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.214846 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1375/2764] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:04.218774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1390/2765] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:04.228379 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4400c19-0b25-4fb9-b5ef-3ac3e94e4737 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.228755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4400c19-0b25-4fb9-b5ef-3ac3e94e4737 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.229133 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4400c19-0b25-4fb9-b5ef-3ac3e94e4737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.248980 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f4400c19-0b25-4fb9-b5ef-3ac3e94e4737 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:04.250637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f4400c19-0b25-4fb9-b5ef-3ac3e94e4737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:04.263158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1376/2766] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:04.267761 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18e01-0b60-4945-bb9c-9210aca9636e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.280968 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18e01-0b60-4945-bb9c-9210aca9636e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.286863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.287613 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.287910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.288154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.288882 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:04.289187 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.290831 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.305488 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1391/2767] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:39:04.310277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4400c19-0b25-4fb9-b5ef-3ac3e94e4737 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.321114 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4400c19-0b25-4fb9-b5ef-3ac3e94e4737 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.327102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9597d-63e4-48f8-80c5-2badb8bf0468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.327778 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9597d-63e4-48f8-80c5-2badb8bf0468 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.328056 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9597d-63e4-48f8-80c5-2badb8bf0468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.329236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9597d-63e4-48f8-80c5-2badb8bf0468 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.329236 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9597d-63e4-48f8-80c5-2badb8bf0468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.331231 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9597d-63e4-48f8-80c5-2badb8bf0468 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.359605 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1377/2768] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:04 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:04.364222 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.376519 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876d24-8624-4adc-a53c-4b341b28b689 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.405142 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:04.482185 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.482910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.483220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.483462 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.484258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.486544 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.513526 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1392/2769] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:04 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:39:04.518653 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9597d-63e4-48f8-80c5-2badb8bf0468 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.525478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.527362 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:04.538835 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9597d-63e4-48f8-80c5-2badb8bf0468 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.541472 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef598d1-2b60-4949-ab60-fdf61255e8e9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.544822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828ad93-96ef-48e2-bee6-27c5e4fd11b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.545637 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ad93-96ef-48e2-bee6-27c5e4fd11b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.545923 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ad93-96ef-48e2-bee6-27c5e4fd11b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.546194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ad93-96ef-48e2-bee6-27c5e4fd11b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.546931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ad93-96ef-48e2-bee6-27c5e4fd11b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.547205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.548372 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.548586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ad93-96ef-48e2-bee6-27c5e4fd11b4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.548972 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.549396 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] PATH_INFO: `/v3/projects/d4b5bab9f53f408c9ecf3acd79986576` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.551024 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b5bab9f53f408c9ecf3acd79986576)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.553926 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.561393 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1378/2770] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:04.565685 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828ad93-96ef-48e2-bee6-27c5e4fd11b4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.575912 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828ad93-96ef-48e2-bee6-27c5e4fd11b4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.581865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfd0f0-964a-4f6e-b074-4f0bae0d66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.582550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd0f0-964a-4f6e-b074-4f0bae0d66eb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.582825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd0f0-964a-4f6e-b074-4f0bae0d66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.583391 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd0f0-964a-4f6e-b074-4f0bae0d66eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.584101 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfd0f0-964a-4f6e-b074-4f0bae0d66eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.585792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfd0f0-964a-4f6e-b074-4f0bae0d66eb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.597064 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1379/2771] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:04.601592 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfd0f0-964a-4f6e-b074-4f0bae0d66eb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.612981 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfd0f0-964a-4f6e-b074-4f0bae0d66eb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.616266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b5bab9f53f408c9ecf3acd79986576', 'request_id': 'req-9bf04d62-f6d0-4208-99b1-5db11f29b161'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.622785 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:04.625624 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b5bab9f53f408c9ecf3acd79986576', 'request_id': 'req-9bf04d62-f6d0-4208-99b1-5db11f29b161'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.631884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b5bab9f53f408c9ecf3acd79986576', 'request_id': 'req-9bf04d62-f6d0-4208-99b1-5db11f29b161'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.644521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] The token cache is being invalidate because project d4b5bab9f53f408c9ecf3acd79986576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:04.644797 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.645531 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.647247 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1393/2772] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:04 2022] DELETE /identity/v3/projects/d4b5bab9f53f408c9ecf3acd79986576 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:04.651529 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.653032 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:04.680918 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0184b9-463a-4a45-9672-79d1f66b3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.681827 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0184b9-463a-4a45-9672-79d1f66b3d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.682104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0184b9-463a-4a45-9672-79d1f66b3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.682373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0184b9-463a-4a45-9672-79d1f66b3d4e admin admin] PATH_INFO: `/v3/projects/94a092c20d374ffda03a48f2958a2a4a/users/6c82b33016444710973d30f5f0d99e20/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.698348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0184b9-463a-4a45-9672-79d1f66b3d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a092c20d374ffda03a48f2958a2a4a, user_id=6c82b33016444710973d30f5f0d99e20, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.701053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0184b9-463a-4a45-9672-79d1f66b3d4e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.717453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1380/2773] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:04 2022] PUT /identity/v3/projects/94a092c20d374ffda03a48f2958a2a4a/users/6c82b33016444710973d30f5f0d99e20/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:04.723728 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf04d62-f6d0-4208-99b1-5db11f29b161 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.728666 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1931-4427-477e-ad0a-0b07dc174475 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.728948 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1931-4427-477e-ad0a-0b07dc174475 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.729310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1931-4427-477e-ad0a-0b07dc174475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.757015 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ffcf1931-4427-477e-ad0a-0b07dc174475 None None] MFA Rules not processed for user `6c82b33016444710973d30f5f0d99e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:04.758346 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ffcf1931-4427-477e-ad0a-0b07dc174475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:04.764682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:04.785158 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.786055 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.786331 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.786602 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] PATH_INFO: `/v3/users/b57a99de93c74445b3717e43745fafba` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.787873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57a99de93c74445b3717e43745fafba)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.789810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.834869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1381/2774] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:04.845287 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57a99de93c74445b3717e43745fafba'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.846586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf1931-4427-477e-ad0a-0b07dc174475 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.848142 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ffcf1931-4427-477e-ad0a-0b07dc174475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:04.862720 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57a99de93c74445b3717e43745fafba'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.863486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57a99de93c74445b3717e43745fafba'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.864277 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57a99de93c74445b3717e43745fafba'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.871510 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57a99de93c74445b3717e43745fafba'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.887708 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1394/2775] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:04 2022] DELETE /identity/v3/users/b57a99de93c74445b3717e43745fafba => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:04.913486 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf1931-4427-477e-ad0a-0b07dc174475 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.973903 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:04.984673 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.985425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.985823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.986106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.988310 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.061509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.063034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.072754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1382/2776] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:05.097737 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.099258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.172339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e99c-763b-4b1e-85fd-a6e47f102463 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.177617 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.178589 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.178872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.179214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] PATH_INFO: `/v3/users/6c82b33016444710973d30f5f0d99e20` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.180587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c82b33016444710973d30f5f0d99e20)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.182706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.190027 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.191500 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.206266 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d6911-4ab4-45ed-9ed1-e2da0424028a service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.212189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.213167 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.213475 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.213930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] PATH_INFO: `/v3/projects/ce48bed9ecf945b3a80ca20948de4206` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.215222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce48bed9ecf945b3a80ca20948de4206)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.217158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.243191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c82b33016444710973d30f5f0d99e20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.255517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:05.257639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c82b33016444710973d30f5f0d99e20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.258639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c82b33016444710973d30f5f0d99e20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.259949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c82b33016444710973d30f5f0d99e20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.269116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-03e159f9-2eec-40d7-9b52-e58eb814087d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c82b33016444710973d30f5f0d99e20'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.272332 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce48bed9ecf945b3a80ca20948de4206', 'request_id': 'req-738d751d-f8af-4395-8861-dc2fcf3c7567'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.282371 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce48bed9ecf945b3a80ca20948de4206', 'request_id': 'req-738d751d-f8af-4395-8861-dc2fcf3c7567'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.285428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1395/2777] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:05 2022] DELETE /identity/v3/users/6c82b33016444710973d30f5f0d99e20 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:05.288678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce48bed9ecf945b3a80ca20948de4206', 'request_id': 'req-738d751d-f8af-4395-8861-dc2fcf3c7567'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.290022 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d531-e1c4-4240-a6f0-ff26b0f3db98 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.290316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d531-e1c4-4240-a6f0-ff26b0f3db98 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.290596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6d531-e1c4-4240-a6f0-ff26b0f3db98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.301271 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] The token cache is being invalidate because project ce48bed9ecf945b3a80ca20948de4206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:05.301559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.302244 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-738d751d-f8af-4395-8861-dc2fcf3c7567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.304106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1383/2778] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:05 2022] DELETE /identity/v3/projects/ce48bed9ecf945b3a80ca20948de4206 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:05.308143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c4f6d531-e1c4-4240-a6f0-ff26b0f3db98 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:05.308755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae6a54-2822-4ccc-940a-100b2687df7c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.309045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae6a54-2822-4ccc-940a-100b2687df7c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.309324 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae6a54-2822-4ccc-940a-100b2687df7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.309439 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c4f6d531-e1c4-4240-a6f0-ff26b0f3db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.327047 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-31ae6a54-2822-4ccc-940a-100b2687df7c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:05.328251 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-31ae6a54-2822-4ccc-940a-100b2687df7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.375288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1396/2779] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:05.382481 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6d531-e1c4-4240-a6f0-ff26b0f3db98 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.384047 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c4f6d531-e1c4-4240-a6f0-ff26b0f3db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.392399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1384/2780] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:05.400175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee52bd5-08c4-4d72-bd89-54019368c7a7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.400462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee52bd5-08c4-4d72-bd89-54019368c7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.400740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee52bd5-08c4-4d72-bd89-54019368c7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.418931 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4ee52bd5-08c4-4d72-bd89-54019368c7a7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:05.420178 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ee52bd5-08c4-4d72-bd89-54019368c7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.430449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1385/2781] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:05.434479 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee52bd5-08c4-4d72-bd89-54019368c7a7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.444182 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee52bd5-08c4-4d72-bd89-54019368c7a7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.446997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6d531-e1c4-4240-a6f0-ff26b0f3db98 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.449169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.449840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.450118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.450397 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.450932 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de113ca-4ff5-4a94-8be4-334ae98ac1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.451180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:05.451485 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.451662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de113ca-4ff5-4a94-8be4-334ae98ac1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.451958 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de113ca-4ff5-4a94-8be4-334ae98ac1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.452231 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de113ca-4ff5-4a94-8be4-334ae98ac1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.453116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.462088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de113ca-4ff5-4a94-8be4-334ae98ac1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.462556 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:05.463635 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de113ca-4ff5-4a94-8be4-334ae98ac1f7 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.470651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1386/2782] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:39:05.471665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.477819 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1397/2783] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:05.483557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052c585-aa19-4de7-9fe0-77e42f583594 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.489281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f13c1-6224-47a7-96e8-e9efc9b446c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.489970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f13c1-6224-47a7-96e8-e9efc9b446c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.490358 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f13c1-6224-47a7-96e8-e9efc9b446c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.490638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f13c1-6224-47a7-96e8-e9efc9b446c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.491399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f13c1-6224-47a7-96e8-e9efc9b446c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.493523 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f13c1-6224-47a7-96e8-e9efc9b446c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.521652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1387/2784] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:05.526098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de113ca-4ff5-4a94-8be4-334ae98ac1f7 service neutron] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.536496 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de113ca-4ff5-4a94-8be4-334ae98ac1f7 service neutron] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.601360 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074b74-1d39-43f4-8fb6-3c4b870d8f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.602182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074b74-1d39-43f4-8fb6-3c4b870d8f99 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.602505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074b74-1d39-43f4-8fb6-3c4b870d8f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.602762 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074b74-1d39-43f4-8fb6-3c4b870d8f99 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.603477 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a074b74-1d39-43f4-8fb6-3c4b870d8f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.605423 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a074b74-1d39-43f4-8fb6-3c4b870d8f99 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.630143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1398/2785] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:39:05.633460 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f13c1-6224-47a7-96e8-e9efc9b446c9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.645189 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f13c1-6224-47a7-96e8-e9efc9b446c9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.649979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf99b74-9589-4307-810b-e9691bee83f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.650649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99b74-9589-4307-810b-e9691bee83f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.650926 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99b74-9589-4307-810b-e9691bee83f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.651234 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99b74-9589-4307-810b-e9691bee83f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.651958 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf99b74-9589-4307-810b-e9691bee83f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.653649 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf99b74-9589-4307-810b-e9691bee83f7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.664726 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1388/2786] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:05.669000 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074b74-1d39-43f4-8fb6-3c4b870d8f99 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.680274 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074b74-1d39-43f4-8fb6-3c4b870d8f99 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.686167 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.687002 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.687415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.687553 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.688381 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.690143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.697391 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:05.707171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1399/2787] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:05.710645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf99b74-9589-4307-810b-e9691bee83f7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.721253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf99b74-9589-4307-810b-e9691bee83f7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.726009 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adcbbe-f1a0-4556-a076-df9a65fba253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.726925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adcbbe-f1a0-4556-a076-df9a65fba253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.727261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adcbbe-f1a0-4556-a076-df9a65fba253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.727496 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adcbbe-f1a0-4556-a076-df9a65fba253 admin admin] PATH_INFO: `/v3/projects/66828d8306da4005beb6ed00a29bd22e/users/08a2a16c38164f299ec77b7ab4aefed4/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.746347 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adcbbe-f1a0-4556-a076-df9a65fba253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66828d8306da4005beb6ed00a29bd22e, user_id=08a2a16c38164f299ec77b7ab4aefed4, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.749077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adcbbe-f1a0-4556-a076-df9a65fba253 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.763650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1389/2788] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:05 2022] PUT /identity/v3/projects/66828d8306da4005beb6ed00a29bd22e/users/08a2a16c38164f299ec77b7ab4aefed4/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:05.772467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.774505 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.774886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34a1e-066b-4653-8302-a32e60e8a514 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.775211 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34a1e-066b-4653-8302-a32e60e8a514 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.775481 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34a1e-066b-4653-8302-a32e60e8a514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.795260 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430d1c5-5dd9-4702-9423-6cd85238c70b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.805693 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bfb34a1e-066b-4653-8302-a32e60e8a514 None None] MFA Rules not processed for user `08a2a16c38164f299ec77b7ab4aefed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:05.806997 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bfb34a1e-066b-4653-8302-a32e60e8a514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:05.857652 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.858539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.858822 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.859134 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] PATH_INFO: `/v3/projects/94a092c20d374ffda03a48f2958a2a4a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.860428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a092c20d374ffda03a48f2958a2a4a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.862540 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.875956 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1390/2789] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:05.880557 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34a1e-066b-4653-8302-a32e60e8a514 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.891043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34a1e-066b-4653-8302-a32e60e8a514 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:05.896058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8dec-f736-43fe-90eb-6c38ad841105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:05.896745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8dec-f736-43fe-90eb-6c38ad841105 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.897030 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8dec-f736-43fe-90eb-6c38ad841105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.897338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8dec-f736-43fe-90eb-6c38ad841105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.898034 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a8dec-f736-43fe-90eb-6c38ad841105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:05.900000 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a8dec-f736-43fe-90eb-6c38ad841105 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:05.914614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a092c20d374ffda03a48f2958a2a4a', 'request_id': 'req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.923314 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a092c20d374ffda03a48f2958a2a4a', 'request_id': 'req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.929512 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1391/2790] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:05.929680 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a092c20d374ffda03a48f2958a2a4a', 'request_id': 'req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.931453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8dec-f736-43fe-90eb-6c38ad841105 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:05.940799 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] The token cache is being invalidate because project 94a092c20d374ffda03a48f2958a2a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:05.941097 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.941836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-4ea7bf77-6b05-4236-b796-0fb2ddcd2399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:05.943751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1400/2791] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:05 2022] DELETE /identity/v3/projects/94a092c20d374ffda03a48f2958a2a4a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:05.949413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30941-0669-4ad5-b821-f2ead10226cd None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:05.949776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30941-0669-4ad5-b821-f2ead10226cd None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:05.950052 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac30941-0669-4ad5-b821-f2ead10226cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:05.970662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-2ac30941-0669-4ad5-b821-f2ead10226cd None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:05.971982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-2ac30941-0669-4ad5-b821-f2ead10226cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:06.001652 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8dec-f736-43fe-90eb-6c38ad841105 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.006699 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.007417 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.007709 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.007973 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.008664 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.010634 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.027550 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:06.035130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1392/2792] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:39:06.036929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.037080 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1401/2793] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:06.039442 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:06.044266 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a381-e0b1-4bc2-ab55-da336dccc304 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.044557 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a381-e0b1-4bc2-ab55-da336dccc304 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.044859 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a381-e0b1-4bc2-ab55-da336dccc304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.053889 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8c968-fcbc-4bb1-8440-14f3b7fed421 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.059147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85aadc-a15d-4741-ba72-5b5c4b126324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.059866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85aadc-a15d-4741-ba72-5b5c4b126324 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.060106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85aadc-a15d-4741-ba72-5b5c4b126324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.060389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85aadc-a15d-4741-ba72-5b5c4b126324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.061112 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85aadc-a15d-4741-ba72-5b5c4b126324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.063258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85aadc-a15d-4741-ba72-5b5c4b126324 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.065588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c099a381-e0b1-4bc2-ab55-da336dccc304 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:06.066808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c099a381-e0b1-4bc2-ab55-da336dccc304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:06.073961 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1393/2794] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:06.074872 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1402/2795] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:06.078278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85aadc-a15d-4741-ba72-5b5c4b126324 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.081874 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a381-e0b1-4bc2-ab55-da336dccc304 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.091544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85aadc-a15d-4741-ba72-5b5c4b126324 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.094397 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a381-e0b1-4bc2-ab55-da336dccc304 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.096439 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec78b1-8c97-42d9-960a-ae2024a2826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.097450 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec78b1-8c97-42d9-960a-ae2024a2826c admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.097606 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec78b1-8c97-42d9-960a-ae2024a2826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.097875 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec78b1-8c97-42d9-960a-ae2024a2826c admin admin] PATH_INFO: `/v3/projects/b89dc1f3ef8849c4a8cf67b218c574f0/users/903cd4ac65e34edd8baefcc8d5e9360c/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.100705 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.101502 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.101870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.102225 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] PATH_INFO: `/v3/domains` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.103214 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80224) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:06.103569 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.105290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.114449 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec78b1-8c97-42d9-960a-ae2024a2826c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89dc1f3ef8849c4a8cf67b218c574f0, user_id=903cd4ac65e34edd8baefcc8d5e9360c, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.117156 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec78b1-8c97-42d9-960a-ae2024a2826c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.117681 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1403/2796] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:39:06.122898 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.133764 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1394/2797] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:06 2022] PUT /identity/v3/projects/b89dc1f3ef8849c4a8cf67b218c574f0/users/903cd4ac65e34edd8baefcc8d5e9360c/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:06.134646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e233df-dfd6-471e-b255-01f1a5e85718 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.137852 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec78b1-8c97-42d9-960a-ae2024a2826c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.143261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:06.197677 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce61d2-c710-443d-a46c-4114bf7337bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.198387 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce61d2-c710-443d-a46c-4114bf7337bc admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.198674 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce61d2-c710-443d-a46c-4114bf7337bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.198997 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce61d2-c710-443d-a46c-4114bf7337bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.199921 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce61d2-c710-443d-a46c-4114bf7337bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.202041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce61d2-c710-443d-a46c-4114bf7337bc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.204389 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec78b1-8c97-42d9-960a-ae2024a2826c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.209424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91909ed6-692b-42c4-8fd8-884bd49bfc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.210170 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909ed6-692b-42c4-8fd8-884bd49bfc38 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.210390 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909ed6-692b-42c4-8fd8-884bd49bfc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.210654 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909ed6-692b-42c4-8fd8-884bd49bfc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.211566 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91909ed6-692b-42c4-8fd8-884bd49bfc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.213043 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91909ed6-692b-42c4-8fd8-884bd49bfc38 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.224356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1395/2798] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:06.230471 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91909ed6-692b-42c4-8fd8-884bd49bfc38 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.237050 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1404/2799] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:06 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:06.242255 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce61d2-c710-443d-a46c-4114bf7337bc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.247769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91909ed6-692b-42c4-8fd8-884bd49bfc38 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.318020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce61d2-c710-443d-a46c-4114bf7337bc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.320977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9f0e7-eea2-447c-a30b-e5984980558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.321974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f0e7-eea2-447c-a30b-e5984980558b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.322308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f0e7-eea2-447c-a30b-e5984980558b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.322584 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f0e7-eea2-447c-a30b-e5984980558b admin admin] PATH_INFO: `/v3/projects/b89dc1f3ef8849c4a8cf67b218c574f0/users/903cd4ac65e34edd8baefcc8d5e9360c/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.323071 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a5521-09c4-42fb-a981-42683eff937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.323939 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a5521-09c4-42fb-a981-42683eff937b admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.324281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a5521-09c4-42fb-a981-42683eff937b admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.324665 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a5521-09c4-42fb-a981-42683eff937b admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.324819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9f0e7-eea2-447c-a30b-e5984980558b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89dc1f3ef8849c4a8cf67b218c574f0, user_id=903cd4ac65e34edd8baefcc8d5e9360c, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.325556 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a5521-09c4-42fb-a981-42683eff937b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.327626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9f0e7-eea2-447c-a30b-e5984980558b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.327808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a5521-09c4-42fb-a981-42683eff937b admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.338222 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1396/2800] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:06 2022] PUT /identity/v3/projects/b89dc1f3ef8849c4a8cf67b218c574f0/users/903cd4ac65e34edd8baefcc8d5e9360c/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:06.350815 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0c27-83de-4884-8d2f-31662fc10bac None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.351153 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0c27-83de-4884-8d2f-31662fc10bac None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.351570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0c27-83de-4884-8d2f-31662fc10bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.359141 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1405/2801] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:06 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:06.361075 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a5521-09c4-42fb-a981-42683eff937b admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.371107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a5521-09c4-42fb-a981-42683eff937b admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.381074 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a07c0c27-83de-4884-8d2f-31662fc10bac None None] MFA Rules not processed for user `903cd4ac65e34edd8baefcc8d5e9360c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:06.382313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a07c0c27-83de-4884-8d2f-31662fc10bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:06.430842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:06.433288 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b8674-2e67-42de-b1a1-c991d63955a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.434069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b8674-2e67-42de-b1a1-c991d63955a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.434461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b8674-2e67-42de-b1a1-c991d63955a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.434740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b8674-2e67-42de-b1a1-c991d63955a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.435516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b8674-2e67-42de-b1a1-c991d63955a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.437335 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b8674-2e67-42de-b1a1-c991d63955a9 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.447650 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1406/2802] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:06.451820 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b8674-2e67-42de-b1a1-c991d63955a9 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.457737 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1397/2803] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:06.461440 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b8674-2e67-42de-b1a1-c991d63955a9 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.466724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.467547 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.468910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.468910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.468910 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.471290 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.485596 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1407/2804] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:06.486727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c0c27-83de-4884-8d2f-31662fc10bac None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.498296 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c0c27-83de-4884-8d2f-31662fc10bac None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.503679 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f719bb8-43ed-47a5-90b2-efb1e189c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.504622 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719bb8-43ed-47a5-90b2-efb1e189c59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.504900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719bb8-43ed-47a5-90b2-efb1e189c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.505170 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719bb8-43ed-47a5-90b2-efb1e189c59a admin admin] PATH_INFO: `/v3/projects/8279e0d49a7d44cb86224e1d115fc7db/users/0c4f1cfef86a41c3838e6edab19499e0/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.522356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f719bb8-43ed-47a5-90b2-efb1e189c59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8279e0d49a7d44cb86224e1d115fc7db, user_id=0c4f1cfef86a41c3838e6edab19499e0, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.525301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f719bb8-43ed-47a5-90b2-efb1e189c59a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.527952 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.529985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:06.541329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1398/2805] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:06 2022] PUT /identity/v3/projects/8279e0d49a7d44cb86224e1d115fc7db/users/0c4f1cfef86a41c3838e6edab19499e0/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:06.545616 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:06.546551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7ab8-3c73-4945-a17e-4c70e6dcc855 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.546886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7ab8-3c73-4945-a17e-4c70e6dcc855 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.547170 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7ab8-3c73-4945-a17e-4c70e6dcc855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.565615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-da5e7ab8-3c73-4945-a17e-4c70e6dcc855 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:06.566866 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-da5e7ab8-3c73-4945-a17e-4c70e6dcc855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:06.594978 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb501d-4e35-4f7a-824c-d9e2d9d8cc28 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.631883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1399/2806] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:06.642707 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7ab8-3c73-4945-a17e-4c70e6dcc855 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.644509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-da5e7ab8-3c73-4945-a17e-4c70e6dcc855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:06.661555 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2079e-f48e-40f7-b270-762e06f60999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.662270 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2079e-f48e-40f7-b270-762e06f60999 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.662601 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2079e-f48e-40f7-b270-762e06f60999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.662855 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2079e-f48e-40f7-b270-762e06f60999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.708830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7ab8-3c73-4945-a17e-4c70e6dcc855 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.712612 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0323d99-691a-4f17-b475-29af57eac3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.713269 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0323d99-691a-4f17-b475-29af57eac3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.713551 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0323d99-691a-4f17-b475-29af57eac3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.713821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0323d99-691a-4f17-b475-29af57eac3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.723450 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0323d99-691a-4f17-b475-29af57eac3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.724105 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2079e-f48e-40f7-b270-762e06f60999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.724948 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0323d99-691a-4f17-b475-29af57eac3a0 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.725771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2079e-f48e-40f7-b270-762e06f60999 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.735194 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1400/2807] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:06.735850 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1408/2808] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:06.813172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0323d99-691a-4f17-b475-29af57eac3a0 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:06.825240 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0323d99-691a-4f17-b475-29af57eac3a0 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:06.829373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:06.830169 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:06.830508 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:06.830862 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:06.832811 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:06.905292 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:06.907119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:06.911022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:06.919159 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1401/2809] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:11.125172 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fcd0-cd8d-4116-8494-42d4b8cd54a5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:11.125764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fcd0-cd8d-4116-8494-42d4b8cd54a5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:11.125764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10fcd0-cd8d-4116-8494-42d4b8cd54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:11.156066 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ce10fcd0-cd8d-4116-8494-42d4b8cd54a5 None None] MFA Rules not processed for user `0c4f1cfef86a41c3838e6edab19499e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:11.157328 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ce10fcd0-cd8d-4116-8494-42d4b8cd54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:11.247847 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1409/2810] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:11.253853 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:11.271245 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9c5c9-3e7e-431f-8f15-5e5c3b4ace2d service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:11.278300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52619-72f2-46d6-b1c3-b484cecee05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:11.279197 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52619-72f2-46d6-b1c3-b484cecee05e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:11.279573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52619-72f2-46d6-b1c3-b484cecee05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:11.279863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52619-72f2-46d6-b1c3-b484cecee05e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:11.281583 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba52619-72f2-46d6-b1c3-b484cecee05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:11.283759 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba52619-72f2-46d6-b1c3-b484cecee05e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:11.314162 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1402/2811] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:11 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:11.318685 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10fcd0-cd8d-4116-8494-42d4b8cd54a5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:11.334920 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10fcd0-cd8d-4116-8494-42d4b8cd54a5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:11.339573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:11.406320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13525716-4dde-46cf-a424-d47ba97553e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:11.407342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13525716-4dde-46cf-a424-d47ba97553e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:11.407630 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13525716-4dde-46cf-a424-d47ba97553e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:11.407913 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13525716-4dde-46cf-a424-d47ba97553e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:11.408683 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13525716-4dde-46cf-a424-d47ba97553e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:11.410783 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13525716-4dde-46cf-a424-d47ba97553e4 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:11.434899 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1410/2812] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:11 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:11.439750 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52619-72f2-46d6-b1c3-b484cecee05e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:11.454119 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52619-72f2-46d6-b1c3-b484cecee05e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:11.461711 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad21bf-eb48-48cc-aeac-342a30e253ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:11.462412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad21bf-eb48-48cc-aeac-342a30e253ff admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:11.462665 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad21bf-eb48-48cc-aeac-342a30e253ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:11.462932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad21bf-eb48-48cc-aeac-342a30e253ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:11.463879 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad21bf-eb48-48cc-aeac-342a30e253ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:11.466579 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad21bf-eb48-48cc-aeac-342a30e253ff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:11.483886 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1403/2813] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:11.488425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13525716-4dde-46cf-a424-d47ba97553e4 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:11.500897 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13525716-4dde-46cf-a424-d47ba97553e4 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:11.509989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad30b5-111c-474d-9dd5-1d25159acb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:11.511162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad30b5-111c-474d-9dd5-1d25159acb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:11.511597 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad30b5-111c-474d-9dd5-1d25159acb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:11.511875 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad30b5-111c-474d-9dd5-1d25159acb1d admin admin] PATH_INFO: `/v3/projects/d08f075e134f4713bdbee72d8053b8f7/users/65666c525a6144dba1297cce7c95892a/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:11.535048 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad30b5-111c-474d-9dd5-1d25159acb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08f075e134f4713bdbee72d8053b8f7, user_id=65666c525a6144dba1297cce7c95892a, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:11.537893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad30b5-111c-474d-9dd5-1d25159acb1d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:11.555088 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1411/2814] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:11 2022] PUT /identity/v3/projects/d08f075e134f4713bdbee72d8053b8f7/users/65666c525a6144dba1297cce7c95892a/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:11.559077 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad21bf-eb48-48cc-aeac-342a30e253ff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:11.574427 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad21bf-eb48-48cc-aeac-342a30e253ff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:11.647616 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dfba7-4095-43a6-bf84-1b3d692194b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:11.648116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dfba7-4095-43a6-bf84-1b3d692194b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:11.649111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dfba7-4095-43a6-bf84-1b3d692194b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:11.649111 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dfba7-4095-43a6-bf84-1b3d692194b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:11.649743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dfba7-4095-43a6-bf84-1b3d692194b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:11.651469 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dfba7-4095-43a6-bf84-1b3d692194b4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:11.662353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1404/2815] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:11.667143 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad30b5-111c-474d-9dd5-1d25159acb1d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:11.679884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad30b5-111c-474d-9dd5-1d25159acb1d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:11.689514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e086-3ccb-4fb2-9ea7-d68a09a6bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:11.690428 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e086-3ccb-4fb2-9ea7-d68a09a6bf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:11.691264 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e086-3ccb-4fb2-9ea7-d68a09a6bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:11.691546 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e086-3ccb-4fb2-9ea7-d68a09a6bf78 admin admin] PATH_INFO: `/v3/projects/d08f075e134f4713bdbee72d8053b8f7/users/65666c525a6144dba1297cce7c95892a/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:11.694448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24e086-3ccb-4fb2-9ea7-d68a09a6bf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08f075e134f4713bdbee72d8053b8f7, user_id=65666c525a6144dba1297cce7c95892a, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:11.697389 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24e086-3ccb-4fb2-9ea7-d68a09a6bf78 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:11.712294 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1412/2816] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:11 2022] PUT /identity/v3/projects/d08f075e134f4713bdbee72d8053b8f7/users/65666c525a6144dba1297cce7c95892a/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:14.650079 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dfba7-4095-43a6-bf84-1b3d692194b4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:14.666208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dfba7-4095-43a6-bf84-1b3d692194b4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:14.868175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:14.869113 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:14.869392 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:14.869662 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] PATH_INFO: `/v3/users/08a2a16c38164f299ec77b7ab4aefed4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:14.872205 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a2a16c38164f299ec77b7ab4aefed4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:14.874506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:14.959995 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a2a16c38164f299ec77b7ab4aefed4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.977002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:14.978518 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a2a16c38164f299ec77b7ab4aefed4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.979775 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a2a16c38164f299ec77b7ab4aefed4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.993977 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a2a16c38164f299ec77b7ab4aefed4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.994714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a2a16c38164f299ec77b7ab4aefed4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:15.018196 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1405/2817] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:14 2022] DELETE /identity/v3/users/08a2a16c38164f299ec77b7ab4aefed4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:15.018769 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f279e-10f8-45b7-acd1-ae72ae2faac7 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:15.019378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f279e-10f8-45b7-acd1-ae72ae2faac7 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:15.019517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f279e-10f8-45b7-acd1-ae72ae2faac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:15.046810 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e60f279e-10f8-45b7-acd1-ae72ae2faac7 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:15.048400 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e60f279e-10f8-45b7-acd1-ae72ae2faac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:15.159131 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1413/2818] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:15.173762 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:15.177985 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:15.323184 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2fe81-7f3e-4cc8-b3cc-ff0d1a2e2f42 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:15.350200 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c55204-ca9a-42f2-b984-66b3e8109316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:15.350984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55204-ca9a-42f2-b984-66b3e8109316 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:15.351336 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55204-ca9a-42f2-b984-66b3e8109316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:15.351609 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55204-ca9a-42f2-b984-66b3e8109316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:15.380348 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c55204-ca9a-42f2-b984-66b3e8109316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:15.384011 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c55204-ca9a-42f2-b984-66b3e8109316 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:15.408544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1406/2819] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:16.110251 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f279e-10f8-45b7-acd1-ae72ae2faac7 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:16.113182 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e60f279e-10f8-45b7-acd1-ae72ae2faac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:16.143224 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f279e-10f8-45b7-acd1-ae72ae2faac7 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:16.150809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:16.152204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:16.152718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:16.153881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] PATH_INFO: `/v3/projects/66828d8306da4005beb6ed00a29bd22e` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:16.155860 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=66828d8306da4005beb6ed00a29bd22e)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:16.158856 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:16.247945 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66828d8306da4005beb6ed00a29bd22e', 'request_id': 'req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.256893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:16.284425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66828d8306da4005beb6ed00a29bd22e', 'request_id': 'req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.296403 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66828d8306da4005beb6ed00a29bd22e', 'request_id': 'req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.328804 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] The token cache is being invalidate because project 66828d8306da4005beb6ed00a29bd22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:16.329339 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.331884 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.334590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1414/2820] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:16 2022] DELETE /identity/v3/projects/66828d8306da4005beb6ed00a29bd22e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:16.338490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c55204-ca9a-42f2-b984-66b3e8109316 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:16.355843 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c55204-ca9a-42f2-b984-66b3e8109316 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:16.485594 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:16.486544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:16.486822 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:16.487123 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] PATH_INFO: `/v3/users/903cd4ac65e34edd8baefcc8d5e9360c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:16.488607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903cd4ac65e34edd8baefcc8d5e9360c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:16.495780 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:16.589053 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903cd4ac65e34edd8baefcc8d5e9360c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.610548 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903cd4ac65e34edd8baefcc8d5e9360c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.611743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903cd4ac65e34edd8baefcc8d5e9360c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.622218 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903cd4ac65e34edd8baefcc8d5e9360c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.623045 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb7ea72b-e42f-4dd8-847b-9199162657a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903cd4ac65e34edd8baefcc8d5e9360c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:16.665908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1407/2821] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:16 2022] DELETE /identity/v3/users/903cd4ac65e34edd8baefcc8d5e9360c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:17.086619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.088682 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:17.108364 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2bc1-13d3-40cd-84ef-88e3b084de2d admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.273699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.274827 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.275382 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.276930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] PATH_INFO: `/v3/projects/b89dc1f3ef8849c4a8cf67b218c574f0` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.279407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89dc1f3ef8849c4a8cf67b218c574f0)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.287171 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.392165 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89dc1f3ef8849c4a8cf67b218c574f0', 'request_id': 'req-6645e481-fe00-4938-9d33-d39f46d5b031'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:17.406639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89dc1f3ef8849c4a8cf67b218c574f0', 'request_id': 'req-6645e481-fe00-4938-9d33-d39f46d5b031'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:17.415327 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89dc1f3ef8849c4a8cf67b218c574f0', 'request_id': 'req-6645e481-fe00-4938-9d33-d39f46d5b031'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:17.439495 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] The token cache is being invalidate because project b89dc1f3ef8849c4a8cf67b218c574f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:17.439774 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:17.440318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6645e481-fe00-4938-9d33-d39f46d5b031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:17.443091 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1415/2822] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:17 2022] DELETE /identity/v3/projects/b89dc1f3ef8849c4a8cf67b218c574f0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:17.448283 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91983aa-b13b-4f6d-a0dd-e126804e3495 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.449922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91983aa-b13b-4f6d-a0dd-e126804e3495 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.449922 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91983aa-b13b-4f6d-a0dd-e126804e3495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.455657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:17.479208 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f91983aa-b13b-4f6d-a0dd-e126804e3495 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:17.480509 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f91983aa-b13b-4f6d-a0dd-e126804e3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:17.556982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1408/2823] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:17.564543 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b0d19-a6f4-418c-b54f-eedbc6aefea8 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.564845 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b0d19-a6f4-418c-b54f-eedbc6aefea8 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.565174 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b0d19-a6f4-418c-b54f-eedbc6aefea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.587087 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-810b0d19-a6f4-418c-b54f-eedbc6aefea8 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:17.588751 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-810b0d19-a6f4-418c-b54f-eedbc6aefea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:17.599405 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1416/2824] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:17.610373 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91983aa-b13b-4f6d-a0dd-e126804e3495 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.611517 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8738d4-bb23-4463-b201-e503314787b5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.611808 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8738d4-bb23-4463-b201-e503314787b5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.612085 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8738d4-bb23-4463-b201-e503314787b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.623727 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91983aa-b13b-4f6d-a0dd-e126804e3495 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.629569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.630257 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.630604 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.630908 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.631925 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:17.632206 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.634066 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.641067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-1c8738d4-bb23-4463-b201-e503314787b5 None None] MFA Rules not processed for user `65666c525a6144dba1297cce7c95892a`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:17.642318 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c8738d4-bb23-4463-b201-e503314787b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:17.647274 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1409/2825] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:39:17.651651 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.663810 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6009db-5a1a-4c88-8430-ebc4cf0f804c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.670118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d86ba-078e-4b50-8567-480f11de2baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.671082 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d86ba-078e-4b50-8567-480f11de2baa admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.671480 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d86ba-078e-4b50-8567-480f11de2baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.671760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d86ba-078e-4b50-8567-480f11de2baa admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.672539 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d86ba-078e-4b50-8567-480f11de2baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.675128 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d86ba-078e-4b50-8567-480f11de2baa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.710653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:17.715067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1410/2826] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:17 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:39:17.716989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d86ba-078e-4b50-8567-480f11de2baa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.734497 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1417/2827] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:17.749514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8738d4-bb23-4463-b201-e503314787b5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.751533 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-1c8738d4-bb23-4463-b201-e503314787b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:17.800676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d86ba-078e-4b50-8567-480f11de2baa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.805560 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc82d9-3272-4ca1-853f-d08befc20f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.806249 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc82d9-3272-4ca1-853f-d08befc20f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.806530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc82d9-3272-4ca1-853f-d08befc20f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.806805 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc82d9-3272-4ca1-853f-d08befc20f28 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.807577 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc82d9-3272-4ca1-853f-d08befc20f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.809545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc82d9-3272-4ca1-853f-d08befc20f28 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.826863 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8738d4-bb23-4463-b201-e503314787b5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.833140 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1411/2828] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:17 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:17.837334 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc82d9-3272-4ca1-853f-d08befc20f28 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.847613 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc82d9-3272-4ca1-853f-d08befc20f28 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.852681 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0c33-03f8-4f60-aa26-1cbd01d761e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.853372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0c33-03f8-4f60-aa26-1cbd01d761e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.853659 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0c33-03f8-4f60-aa26-1cbd01d761e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.853940 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0c33-03f8-4f60-aa26-1cbd01d761e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.854676 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0c33-03f8-4f60-aa26-1cbd01d761e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.856350 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e0c33-03f8-4f60-aa26-1cbd01d761e2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.868399 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1412/2829] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:17.872147 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0c33-03f8-4f60-aa26-1cbd01d761e2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.883771 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0c33-03f8-4f60-aa26-1cbd01d761e2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.888572 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f155fe-3737-4db9-85a1-e6a3570e1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.889256 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f155fe-3737-4db9-85a1-e6a3570e1533 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.889629 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f155fe-3737-4db9-85a1-e6a3570e1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.889905 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f155fe-3737-4db9-85a1-e6a3570e1533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.890641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f155fe-3737-4db9-85a1-e6a3570e1533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.892328 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f155fe-3737-4db9-85a1-e6a3570e1533 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.893699 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f69d04-ff51-448f-851c-955b80c040bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac481e3d57a4b6fa07c120ca26f2e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.894765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69d04-ff51-448f-851c-955b80c040bb service glance] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.895632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69d04-ff51-448f-851c-955b80c040bb service glance] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.896108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69d04-ff51-448f-851c-955b80c040bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.898130 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-20f69d04-ff51-448f-851c-955b80c040bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:17.904386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1413/2830] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:17.908745 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f155fe-3737-4db9-85a1-e6a3570e1533 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.919372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f155fe-3737-4db9-85a1-e6a3570e1533 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.924861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b20f-90d6-400e-bd90-a813ef5f74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.926010 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b20f-90d6-400e-bd90-a813ef5f74f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.926155 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b20f-90d6-400e-bd90-a813ef5f74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.926312 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b20f-90d6-400e-bd90-a813ef5f74f0 admin admin] PATH_INFO: `/v3/projects/e35323850ded48688c2d986542fb785c/users/24a8ed450cd34bb893acdd1584c44be8/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.954570 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847b20f-90d6-400e-bd90-a813ef5f74f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35323850ded48688c2d986542fb785c, user_id=24a8ed450cd34bb893acdd1584c44be8, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.957424 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847b20f-90d6-400e-bd90-a813ef5f74f0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.974107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f69d04-ff51-448f-851c-955b80c040bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.975830 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f69d04-ff51-448f-851c-955b80c040bb service glance] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.977378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1414/2831] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:17 2022] PUT /identity/v3/projects/e35323850ded48688c2d986542fb785c/users/24a8ed450cd34bb893acdd1584c44be8/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:17.986467 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1418/2832] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:17.988144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67af78-9cc2-489c-8c93-b6eef5701c3f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.988434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67af78-9cc2-489c-8c93-b6eef5701c3f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.988712 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67af78-9cc2-489c-8c93-b6eef5701c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.009491 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:18.021108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dc67af78-9cc2-489c-8c93-b6eef5701c3f None None] MFA Rules not processed for user `24a8ed450cd34bb893acdd1584c44be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:18.023294 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dc67af78-9cc2-489c-8c93-b6eef5701c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:18.104741 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1415/2833] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:18.108718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae576e-4876-44e4-b5ec-438c40af097e None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.109370 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67af78-9cc2-489c-8c93-b6eef5701c3f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:18.109646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae576e-4876-44e4-b5ec-438c40af097e None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.109938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae576e-4876-44e4-b5ec-438c40af097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.128067 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-efae576e-4876-44e4-b5ec-438c40af097e None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:18.129237 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-efae576e-4876-44e4-b5ec-438c40af097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:18.186042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67af78-9cc2-489c-8c93-b6eef5701c3f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:18.191126 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c1358-712b-44bb-98fe-e35915cbc263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:18.191806 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c1358-712b-44bb-98fe-e35915cbc263 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.192076 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c1358-712b-44bb-98fe-e35915cbc263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.192353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c1358-712b-44bb-98fe-e35915cbc263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.193175 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c1358-712b-44bb-98fe-e35915cbc263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:18.195979 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c1358-712b-44bb-98fe-e35915cbc263 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:18.196159 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1419/2834] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:18.215196 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae576e-4876-44e4-b5ec-438c40af097e None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:18.217156 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-efae576e-4876-44e4-b5ec-438c40af097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:18.226042 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1416/2835] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:18 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:18.228919 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:18.230510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c1358-712b-44bb-98fe-e35915cbc263 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:18.308826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c1358-712b-44bb-98fe-e35915cbc263 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:18.313672 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425c04-21f5-458f-b4cf-a358d93e641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:18.314354 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425c04-21f5-458f-b4cf-a358d93e641c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.314636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425c04-21f5-458f-b4cf-a358d93e641c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.314910 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425c04-21f5-458f-b4cf-a358d93e641c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.315650 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d425c04-21f5-458f-b4cf-a358d93e641c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:18.317323 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae576e-4876-44e4-b5ec-438c40af097e None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:18.317821 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d425c04-21f5-458f-b4cf-a358d93e641c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:18.339950 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1417/2836] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:18 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:18.344012 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425c04-21f5-458f-b4cf-a358d93e641c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:18.354437 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425c04-21f5-458f-b4cf-a358d93e641c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:18.359884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687c895-85a1-42ec-a620-055f2162ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:18.360223 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c895-85a1-42ec-a620-055f2162ac83 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.360507 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c895-85a1-42ec-a620-055f2162ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.360782 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c895-85a1-42ec-a620-055f2162ac83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.361554 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687c895-85a1-42ec-a620-055f2162ac83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:18.363453 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687c895-85a1-42ec-a620-055f2162ac83 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:18.376517 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1418/2837] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:18.381254 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687c895-85a1-42ec-a620-055f2162ac83 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:18.385756 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67122369-83c1-448f-96bc-7206ea7ba0cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:18.386558 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67122369-83c1-448f-96bc-7206ea7ba0cf service swift] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.386834 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67122369-83c1-448f-96bc-7206ea7ba0cf service swift] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.387192 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67122369-83c1-448f-96bc-7206ea7ba0cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.387834 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:18.392326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687c895-85a1-42ec-a620-055f2162ac83 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:18.401261 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0ebe-6f19-420e-aea0-7a1b3072c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:18.402755 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0ebe-6f19-420e-aea0-7a1b3072c81b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.403279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0ebe-6f19-420e-aea0-7a1b3072c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.403983 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0ebe-6f19-420e-aea0-7a1b3072c81b admin admin] PATH_INFO: `/v3/projects/0cf5097c398f4b079cfb2b1e47e94974/users/b0f248c602f74ac6994e86ff57b8e844/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.424412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e0ebe-6f19-420e-aea0-7a1b3072c81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf5097c398f4b079cfb2b1e47e94974, user_id=b0f248c602f74ac6994e86ff57b8e844, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:18.428413 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e0ebe-6f19-420e-aea0-7a1b3072c81b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:18.447838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67122369-83c1-448f-96bc-7206ea7ba0cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:18.448372 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1419/2838] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:18 2022] PUT /identity/v3/projects/0cf5097c398f4b079cfb2b1e47e94974/users/b0f248c602f74ac6994e86ff57b8e844/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:18.449807 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67122369-83c1-448f-96bc-7206ea7ba0cf service swift] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:18.452553 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0ebe-6f19-420e-aea0-7a1b3072c81b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:18.462124 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1420/2839] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:39:18.565087 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0ebe-6f19-420e-aea0-7a1b3072c81b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:18.573024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90673dd-9458-4b18-89d4-ef43cfde83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:18.573963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90673dd-9458-4b18-89d4-ef43cfde83a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.574366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90673dd-9458-4b18-89d4-ef43cfde83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.574786 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90673dd-9458-4b18-89d4-ef43cfde83a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.575725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90673dd-9458-4b18-89d4-ef43cfde83a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:18.577631 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90673dd-9458-4b18-89d4-ef43cfde83a6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:18.592501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1420/2840] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:18.598750 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67122369-83c1-448f-96bc-7206ea7ba0cf service swift] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:18.611622 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67122369-83c1-448f-96bc-7206ea7ba0cf service swift] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:18.619414 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:18.619771 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.620051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.620321 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] PATH_INFO: `/v3/projects/0cf5097c398f4b079cfb2b1e47e94974/users/b0f248c602f74ac6994e86ff57b8e844/roles/f90ad41cff42473fb69ee5af3b163368` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.622511 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf5097c398f4b079cfb2b1e47e94974, user_id=b0f248c602f74ac6994e86ff57b8e844, role_id=f90ad41cff42473fb69ee5af3b163368)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:18.625567 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:18.657108 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1421/2841] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:18 2022] PUT /identity/v3/projects/0cf5097c398f4b079cfb2b1e47e94974/users/b0f248c602f74ac6994e86ff57b8e844/roles/f90ad41cff42473fb69ee5af3b163368 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:18.670338 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bffd8-a0cd-486a-b1fa-017a67a3977f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:18.670646 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bffd8-a0cd-486a-b1fa-017a67a3977f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:18.671814 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bffd8-a0cd-486a-b1fa-017a67a3977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:18.729313 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ee1bffd8-a0cd-486a-b1fa-017a67a3977f None None] MFA Rules not processed for user `b0f248c602f74ac6994e86ff57b8e844`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:18.733279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ee1bffd8-a0cd-486a-b1fa-017a67a3977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:18.869214 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1421/2842] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:18.884721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:18.888815 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:18.992806 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:19.049021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1694f-c1b9-48eb-a390-3744315732bf admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:19.054876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64656a8f-2911-436f-bc88-f86f84231ce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:19.055940 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656a8f-2911-436f-bc88-f86f84231ce0 service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:19.056081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656a8f-2911-436f-bc88-f86f84231ce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:19.056329 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656a8f-2911-436f-bc88-f86f84231ce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:19.068759 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64656a8f-2911-436f-bc88-f86f84231ce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:19.072006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64656a8f-2911-436f-bc88-f86f84231ce0 service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:19.121157 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1422/2843] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:19.142701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bffd8-a0cd-486a-b1fa-017a67a3977f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:19.239078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bffd8-a0cd-486a-b1fa-017a67a3977f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:19.248494 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:19.249724 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:19.250006 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:19.250284 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] PATH_INFO: `/v3/users/24a8ed450cd34bb893acdd1584c44be8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:19.252192 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a8ed450cd34bb893acdd1584c44be8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:19.254504 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:19.258092 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:19.359516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a8ed450cd34bb893acdd1584c44be8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:19.399863 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a8ed450cd34bb893acdd1584c44be8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:19.402072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a8ed450cd34bb893acdd1584c44be8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:19.416212 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a8ed450cd34bb893acdd1584c44be8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:19.416971 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a8ed450cd34bb893acdd1584c44be8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:19.449419 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1422/2844] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:19 2022] DELETE /identity/v3/users/24a8ed450cd34bb893acdd1584c44be8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:19.454186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14c98-2b13-4a9b-9e47-35a7143c00e5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:19.454688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14c98-2b13-4a9b-9e47-35a7143c00e5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:19.454809 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14c98-2b13-4a9b-9e47-35a7143c00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:19.491455 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ade14c98-2b13-4a9b-9e47-35a7143c00e5 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:19.493346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ade14c98-2b13-4a9b-9e47-35a7143c00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:19.590006 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1423/2845] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:19.600864 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:19.603239 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:19.722458 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7259a3-ce5a-4866-a20d-3230ff727302 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:19.726774 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55a2c2-5492-469c-ba43-3815ae5a64a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:19.727630 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a2c2-5492-469c-ba43-3815ae5a64a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:19.727902 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a2c2-5492-469c-ba43-3815ae5a64a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:19.728177 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a2c2-5492-469c-ba43-3815ae5a64a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:19.752270 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55a2c2-5492-469c-ba43-3815ae5a64a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:19.754623 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55a2c2-5492-469c-ba43-3815ae5a64a2 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:19.776028 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1423/2846] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:20.324941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade14c98-2b13-4a9b-9e47-35a7143c00e5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:20.329639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ade14c98-2b13-4a9b-9e47-35a7143c00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:20.369686 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade14c98-2b13-4a9b-9e47-35a7143c00e5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:20.386008 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:20.386943 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:20.387280 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:20.387530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] PATH_INFO: `/v3/projects/e35323850ded48688c2d986542fb785c` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:20.389034 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35323850ded48688c2d986542fb785c)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:20.391037 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:20.482297 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35323850ded48688c2d986542fb785c', 'request_id': 'req-76d801c0-4579-4d71-b9c4-2b25838c3534'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.508043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35323850ded48688c2d986542fb785c', 'request_id': 'req-76d801c0-4579-4d71-b9c4-2b25838c3534'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.521096 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35323850ded48688c2d986542fb785c', 'request_id': 'req-76d801c0-4579-4d71-b9c4-2b25838c3534'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.537639 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] The token cache is being invalidate because project e35323850ded48688c2d986542fb785c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:20.537985 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.538838 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.542790 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1424/2847] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:20 2022] DELETE /identity/v3/projects/e35323850ded48688c2d986542fb785c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:20.549963 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55a2c2-5492-469c-ba43-3815ae5a64a2 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:20.576716 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55a2c2-5492-469c-ba43-3815ae5a64a2 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:20.676795 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:20.678899 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:20.679315 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:20.679686 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] PATH_INFO: `/v3/users/b0f248c602f74ac6994e86ff57b8e844` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:20.681104 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f248c602f74ac6994e86ff57b8e844)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:20.683441 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:20.739854 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:20.791731 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f248c602f74ac6994e86ff57b8e844'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.809180 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f248c602f74ac6994e86ff57b8e844'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.813241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f248c602f74ac6994e86ff57b8e844'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.823295 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f248c602f74ac6994e86ff57b8e844'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.824559 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c79bd305-f56d-42fc-b589-173f32be5c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f248c602f74ac6994e86ff57b8e844'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:20.849767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1424/2848] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:20 2022] DELETE /identity/v3/users/b0f248c602f74ac6994e86ff57b8e844 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:21.304254 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:21.306429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:21.331653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d801c0-4579-4d71-b9c4-2b25838c3534 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:21.418993 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:21.436452 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:21.438826 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:21.439149 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:21.439309 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] PATH_INFO: `/v3/projects/0cf5097c398f4b079cfb2b1e47e94974` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:21.442186 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf5097c398f4b079cfb2b1e47e94974)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:21.444516 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:21.546944 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf5097c398f4b079cfb2b1e47e94974', 'request_id': 'req-d4336d2b-124b-40bc-8d97-4c43ddbb0476'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:21.565053 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf5097c398f4b079cfb2b1e47e94974', 'request_id': 'req-d4336d2b-124b-40bc-8d97-4c43ddbb0476'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:21.585514 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf5097c398f4b079cfb2b1e47e94974', 'request_id': 'req-d4336d2b-124b-40bc-8d97-4c43ddbb0476'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:21.607257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] The token cache is being invalidate because project 0cf5097c398f4b079cfb2b1e47e94974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:21.607257 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:21.607587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-d4336d2b-124b-40bc-8d97-4c43ddbb0476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:21.620646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1425/2849] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:21 2022] DELETE /identity/v3/projects/0cf5097c398f4b079cfb2b1e47e94974 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:21.626078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d962c7-11e0-4bd5-b03f-349970f4b13c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:21.626743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d962c7-11e0-4bd5-b03f-349970f4b13c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:21.626743 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d962c7-11e0-4bd5-b03f-349970f4b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:21.678367 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-06d962c7-11e0-4bd5-b03f-349970f4b13c None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:21.679688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-06d962c7-11e0-4bd5-b03f-349970f4b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:21.788599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1425/2850] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:21.808023 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062e41b-3423-4216-a9fe-c3046df0a930 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:21.808383 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062e41b-3423-4216-a9fe-c3046df0a930 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:21.808672 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062e41b-3423-4216-a9fe-c3046df0a930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:21.836644 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-d062e41b-3423-4216-a9fe-c3046df0a930 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:21.838081 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d062e41b-3423-4216-a9fe-c3046df0a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:21.865161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1426/2851] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:21.869490 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d962c7-11e0-4bd5-b03f-349970f4b13c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:21.883989 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d962c7-11e0-4bd5-b03f-349970f4b13c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:21.896172 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:21.896817 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:21.897100 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:21.897378 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:21.898173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:21.898506 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:21.900355 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:21.926300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1426/2852] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:39:21.930594 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062e41b-3423-4216-a9fe-c3046df0a930 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:21.954711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062e41b-3423-4216-a9fe-c3046df0a930 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:21.960941 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84502808-f356-47f5-a278-885740d66fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:21.961642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502808-f356-47f5-a278-885740d66fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:21.961924 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502808-f356-47f5-a278-885740d66fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:21.962261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84502808-f356-47f5-a278-885740d66fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:21.962996 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84502808-f356-47f5-a278-885740d66fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:21.965388 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84502808-f356-47f5-a278-885740d66fa0 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:22.016042 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1427/2853] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:21 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:39:22.022840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:22.051115 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01b27-caaa-49cf-bcdf-959b7d9e33ab admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:22.156937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee663be-acc8-4905-a9a3-abfc019cbd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:22.157932 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee663be-acc8-4905-a9a3-abfc019cbd83 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.158434 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee663be-acc8-4905-a9a3-abfc019cbd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.158715 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee663be-acc8-4905-a9a3-abfc019cbd83 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.159970 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee663be-acc8-4905-a9a3-abfc019cbd83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:22.163760 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee663be-acc8-4905-a9a3-abfc019cbd83 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:22.230021 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1427/2854] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:22 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:22.235662 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84502808-f356-47f5-a278-885740d66fa0 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:22.248953 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84502808-f356-47f5-a278-885740d66fa0 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:22.256673 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a271a-d35f-472e-898b-a3ebac768cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:22.257765 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a271a-d35f-472e-898b-a3ebac768cea admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.258051 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a271a-d35f-472e-898b-a3ebac768cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.258320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a271a-d35f-472e-898b-a3ebac768cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.259107 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a271a-d35f-472e-898b-a3ebac768cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:22.260823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a271a-d35f-472e-898b-a3ebac768cea admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:22.280043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1428/2855] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:22.288636 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee663be-acc8-4905-a9a3-abfc019cbd83 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:22.307482 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee663be-acc8-4905-a9a3-abfc019cbd83 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:22.313545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a08f-8dc7-4ae3-bb03-ca7b56610f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:22.314304 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a08f-8dc7-4ae3-bb03-ca7b56610f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.314589 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a08f-8dc7-4ae3-bb03-ca7b56610f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.315457 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a08f-8dc7-4ae3-bb03-ca7b56610f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.321943 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a08f-8dc7-4ae3-bb03-ca7b56610f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:22.326188 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a08f-8dc7-4ae3-bb03-ca7b56610f5c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:22.351433 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1428/2856] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:22.355133 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a271a-d35f-472e-898b-a3ebac768cea admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:22.370346 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a271a-d35f-472e-898b-a3ebac768cea admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:22.380098 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:22.381392 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.381892 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.382554 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] PATH_INFO: `/v3/projects/e8da86db0b3a4cf380440fbcaf06854f/users/3acff23cedda49fb87c2cc5480d8c56e/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.408458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8da86db0b3a4cf380440fbcaf06854f, user_id=3acff23cedda49fb87c2cc5480d8c56e, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:22.412162 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:22.435906 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1429/2857] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:22 2022] PUT /identity/v3/projects/e8da86db0b3a4cf380440fbcaf06854f/users/3acff23cedda49fb87c2cc5480d8c56e/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:22.448946 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa8401-2ccb-4896-b5f4-ebdbf87c0404 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.449829 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa8401-2ccb-4896-b5f4-ebdbf87c0404 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.450599 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa8401-2ccb-4896-b5f4-ebdbf87c0404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.482420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:22.502545 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-45fa8401-2ccb-4896-b5f4-ebdbf87c0404 None None] MFA Rules not processed for user `3acff23cedda49fb87c2cc5480d8c56e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:22.504067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-45fa8401-2ccb-4896-b5f4-ebdbf87c0404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:22.621116 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1429/2858] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:22.632981 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:22.635857 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:22.796179 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfce82-9703-45fa-9400-6de51a81f191 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:22.815575 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29de38e-e151-4626-b70a-d2270fd2a26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:22.817478 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de38e-e151-4626-b70a-d2270fd2a26d service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.820707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de38e-e151-4626-b70a-d2270fd2a26d service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.820707 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de38e-e151-4626-b70a-d2270fd2a26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.842429 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29de38e-e151-4626-b70a-d2270fd2a26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:22.844136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29de38e-e151-4626-b70a-d2270fd2a26d service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:22.867457 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1430/2859] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:22.912783 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa8401-2ccb-4896-b5f4-ebdbf87c0404 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:23.065917 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa8401-2ccb-4896-b5f4-ebdbf87c0404 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:23.071173 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:23.072106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.072375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.072645 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] PATH_INFO: `/v3/users/3acff23cedda49fb87c2cc5480d8c56e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.074023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acff23cedda49fb87c2cc5480d8c56e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:23.076307 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:23.167190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acff23cedda49fb87c2cc5480d8c56e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.192939 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acff23cedda49fb87c2cc5480d8c56e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.193714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acff23cedda49fb87c2cc5480d8c56e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.202790 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acff23cedda49fb87c2cc5480d8c56e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.203567 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acff23cedda49fb87c2cc5480d8c56e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.222982 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1430/2860] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:22 2022] DELETE /identity/v3/users/3acff23cedda49fb87c2cc5480d8c56e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:23.228421 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156495a-ecb7-4591-9f63-587643abf706 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.229568 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156495a-ecb7-4591-9f63-587643abf706 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.230082 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156495a-ecb7-4591-9f63-587643abf706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.264915 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-7156495a-ecb7-4591-9f63-587643abf706 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:23.267701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7156495a-ecb7-4591-9f63-587643abf706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:23.309005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:23.400929 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1431/2861] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:23.412278 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:23.414298 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:23.441845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:23.514444 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8d638-87ca-46dd-b5e8-8f8e4708004b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:23.521794 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9870b3-c144-493a-9ca6-6fe079e0de17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:23.522489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9870b3-c144-493a-9ca6-6fe079e0de17 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.522772 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9870b3-c144-493a-9ca6-6fe079e0de17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.523085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9870b3-c144-493a-9ca6-6fe079e0de17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.540019 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9870b3-c144-493a-9ca6-6fe079e0de17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:23.541565 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9870b3-c144-493a-9ca6-6fe079e0de17 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:23.554386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1431/2862] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:23.898422 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156495a-ecb7-4591-9f63-587643abf706 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:23.900342 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-7156495a-ecb7-4591-9f63-587643abf706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:23.934276 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156495a-ecb7-4591-9f63-587643abf706 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:23.942868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:23.950153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.950153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.950153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] PATH_INFO: `/v3/projects/e8da86db0b3a4cf380440fbcaf06854f` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.950153 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8da86db0b3a4cf380440fbcaf06854f)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:23.950587 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.011989 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8da86db0b3a4cf380440fbcaf06854f', 'request_id': 'req-a6b0842c-8635-4525-bba3-b7f938c04ee3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:24.023907 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8da86db0b3a4cf380440fbcaf06854f', 'request_id': 'req-a6b0842c-8635-4525-bba3-b7f938c04ee3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:24.036871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8da86db0b3a4cf380440fbcaf06854f', 'request_id': 'req-a6b0842c-8635-4525-bba3-b7f938c04ee3'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:24.058204 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] The token cache is being invalidate because project e8da86db0b3a4cf380440fbcaf06854f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:24.058503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:24.059205 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-a6b0842c-8635-4525-bba3-b7f938c04ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:24.064348 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1432/2863] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:23 2022] DELETE /identity/v3/projects/e8da86db0b3a4cf380440fbcaf06854f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:24.065819 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de13c1-c635-4c42-9e52-32e76eb83f22 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.066337 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de13c1-c635-4c42-9e52-32e76eb83f22 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.066463 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de13c1-c635-4c42-9e52-32e76eb83f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.084701 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a6de13c1-c635-4c42-9e52-32e76eb83f22 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:24.085930 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a6de13c1-c635-4c42-9e52-32e76eb83f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:24.168725 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1432/2864] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:24.178311 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f6d68-cfae-4b71-b58c-f243ef3b90b5 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.179245 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f6d68-cfae-4b71-b58c-f243ef3b90b5 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.179606 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f6d68-cfae-4b71-b58c-f243ef3b90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.210486 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-555f6d68-cfae-4b71-b58c-f243ef3b90b5 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:24.212005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-555f6d68-cfae-4b71-b58c-f243ef3b90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:24.224734 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1433/2865] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:24.227431 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de13c1-c635-4c42-9e52-32e76eb83f22 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.238826 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de13c1-c635-4c42-9e52-32e76eb83f22 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.244473 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.245228 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.246395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.246395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.246638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:24.246746 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.249425 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.276207 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1433/2866] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:39:24.279493 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f6d68-cfae-4b71-b58c-f243ef3b90b5 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.293851 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f6d68-cfae-4b71-b58c-f243ef3b90b5 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.298844 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cad03-7ca4-4e99-aa02-1aeb761a3027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.299549 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cad03-7ca4-4e99-aa02-1aeb761a3027 admin admin] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.303618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cad03-7ca4-4e99-aa02-1aeb761a3027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.303618 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cad03-7ca4-4e99-aa02-1aeb761a3027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.304256 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cad03-7ca4-4e99-aa02-1aeb761a3027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.306113 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cad03-7ca4-4e99-aa02-1aeb761a3027 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.342590 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1434/2867] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:24 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:24.347503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.360465 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621e11d-6c72-497b-97ad-f545e349ec35 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.445516 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542bbc-4700-4aac-9f14-aeb0c7c57171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.446193 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542bbc-4700-4aac-9f14-aeb0c7c57171 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.446591 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542bbc-4700-4aac-9f14-aeb0c7c57171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.446878 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542bbc-4700-4aac-9f14-aeb0c7c57171 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.447638 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03542bbc-4700-4aac-9f14-aeb0c7c57171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.451326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03542bbc-4700-4aac-9f14-aeb0c7c57171 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.476204 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1434/2868] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:24 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:24.480358 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cad03-7ca4-4e99-aa02-1aeb761a3027 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.495654 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cad03-7ca4-4e99-aa02-1aeb761a3027 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.504688 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14b67-8b1c-4ecd-82c3-aadaa6953078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.505642 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14b67-8b1c-4ecd-82c3-aadaa6953078 admin admin] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.506021 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14b67-8b1c-4ecd-82c3-aadaa6953078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.506304 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14b67-8b1c-4ecd-82c3-aadaa6953078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.507090 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c14b67-8b1c-4ecd-82c3-aadaa6953078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.508764 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c14b67-8b1c-4ecd-82c3-aadaa6953078 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.522233 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1435/2869] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:39:24.525702 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542bbc-4700-4aac-9f14-aeb0c7c57171 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.538342 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542bbc-4700-4aac-9f14-aeb0c7c57171 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.545542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46afb00-d8d6-44fd-910f-fdb0f56b1a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.546366 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46afb00-d8d6-44fd-910f-fdb0f56b1a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.546937 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46afb00-d8d6-44fd-910f-fdb0f56b1a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.547356 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46afb00-d8d6-44fd-910f-fdb0f56b1a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.548883 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46afb00-d8d6-44fd-910f-fdb0f56b1a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.550751 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46afb00-d8d6-44fd-910f-fdb0f56b1a4b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.568677 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1435/2870] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:24.570102 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14b67-8b1c-4ecd-82c3-aadaa6953078 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.588538 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14b67-8b1c-4ecd-82c3-aadaa6953078 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.595721 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.596678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.597020 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.597301 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] PATH_INFO: `/v3/projects/bc2b763d8f844ad2b65ef2e874cdb926/users/52aeb3628f4e47b1a5d0100feaded87d/roles/cbefb946f31c4d86944cb79fb63e9e8a` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.618524 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2b763d8f844ad2b65ef2e874cdb926, user_id=52aeb3628f4e47b1a5d0100feaded87d, role_id=cbefb946f31c4d86944cb79fb63e9e8a)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.621393 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.644967 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1436/2871] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:24 2022] PUT /identity/v3/projects/bc2b763d8f844ad2b65ef2e874cdb926/users/52aeb3628f4e47b1a5d0100feaded87d/roles/cbefb946f31c4d86944cb79fb63e9e8a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:24.657974 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa1c6-52c2-42ee-9bac-88a276cfeeb4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.658542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa1c6-52c2-42ee-9bac-88a276cfeeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.658824 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa1c6-52c2-42ee-9bac-88a276cfeeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.692900 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-33efa1c6-52c2-42ee-9bac-88a276cfeeb4 None None] MFA Rules not processed for user `52aeb3628f4e47b1a5d0100feaded87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:24.694144 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-33efa1c6-52c2-42ee-9bac-88a276cfeeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:24.708329 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:24.775714 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1436/2872] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:24.783886 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.785878 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:24.850448 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:24.867687 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c269691-78de-4a26-b47d-d14211598dbc admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.871583 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc8b95ffc2324085bc736a6fa10f73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.872453 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.872732 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.873005 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.886534 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.888411 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.901140 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1437/2873] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:26.490851 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5d00-144b-4ea6-b030-038864fa300d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:26.493040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5d00-144b-4ea6-b030-038864fa300d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:26.493040 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5d00-144b-4ea6-b030-038864fa300d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:26.517840 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-80df5d00-144b-4ea6-b030-038864fa300d None None] MFA Rules not processed for user `52aeb3628f4e47b1a5d0100feaded87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:26.519300 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-80df5d00-144b-4ea6-b030-038864fa300d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:26.544129 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1437/2874] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:27.124407 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:27.126678 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:27.230415 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af5ed6-c06f-40b4-be1b-187b21c4fbbb service cinder] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:27.240151 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:27.240916 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:27.241268 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:27.241641 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:27.244825 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:27.261835 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:27.263701 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:27.280970 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1438/2875] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:28.644825 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fb54-0a4d-4a23-8c3a-321ad86ba251 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:28.645382 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fb54-0a4d-4a23-8c3a-321ad86ba251 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:28.645663 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fb54-0a4d-4a23-8c3a-321ad86ba251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:28.665067 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a928fb54-0a4d-4a23-8c3a-321ad86ba251 None None] MFA Rules not processed for user `0c4f1cfef86a41c3838e6edab19499e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:28.666281 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a928fb54-0a4d-4a23-8c3a-321ad86ba251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:28.726987 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1438/2876] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:29.063069 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:29.064706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:29.124027 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a307-cfb5-45c6-87c7-da2668959b07 service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:29.128209 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600625e-b4f6-4388-a275-034c1e2fcebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:29.128873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600625e-b4f6-4388-a275-034c1e2fcebe service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:29.129154 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600625e-b4f6-4388-a275-034c1e2fcebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:29.129427 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600625e-b4f6-4388-a275-034c1e2fcebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:29.131433 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-d600625e-b4f6-4388-a275-034c1e2fcebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:29.141776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600625e-b4f6-4388-a275-034c1e2fcebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:29.143258 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600625e-b4f6-4388-a275-034c1e2fcebe service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:29.153984 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1439/2877] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:29.781158 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928fb54-0a4d-4a23-8c3a-321ad86ba251 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:29.798820 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928fb54-0a4d-4a23-8c3a-321ad86ba251 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:29.803791 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:29.804456 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:29.804734 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:29.805004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:29.807241 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:29.820944 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:29.822776 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:29.835190 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1439/2878] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:31.014041 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06db35-740d-4bbd-9188-c465ee17fa35 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:31.014611 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06db35-740d-4bbd-9188-c465ee17fa35 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:31.014711 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06db35-740d-4bbd-9188-c465ee17fa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:31.033776 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-8a06db35-740d-4bbd-9188-c465ee17fa35 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:31.036456 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a06db35-740d-4bbd-9188-c465ee17fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:31.118609 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1440/2879] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:39:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:31.131868 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:31.133865 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:31.252717 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f67495-6709-4a08-9968-2c290d82862c service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:31.257984 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:31.258773 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:31.259078 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:31.259353 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:31.269609 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:31.271497 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:31.280823 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1440/2880] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:39:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:39:39.789184 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06db35-740d-4bbd-9188-c465ee17fa35 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:39.790653 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-8a06db35-740d-4bbd-9188-c465ee17fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:39.830716 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=100 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:39.886957 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06db35-740d-4bbd-9188-c465ee17fa35 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:39.895608 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d3853-250a-41fe-a0d0-e32c991f5c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:39.896320 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3853-250a-41fe-a0d0-e32c991f5c43 service nova] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:39.896614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3853-250a-41fe-a0d0-e32c991f5c43 service nova] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:39.896893 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3853-250a-41fe-a0d0-e32c991f5c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:39.901710 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ca6d3853-250a-41fe-a0d0-e32c991f5c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:39.917261 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d3853-250a-41fe-a0d0-e32c991f5c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:39.918877 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d3853-250a-41fe-a0d0-e32c991f5c43 service nova] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:39.936742 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1441/2881] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:41.277062 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:43.728787 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:43.730401 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:43.749688 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b194df9-17c7-459f-9aa3-c11a75b76d2c service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:43.756416 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:43.757102 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:43.757384 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:43.757657 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:43.759839 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:43.774023 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:43.775752 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:43.787164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1441/2882] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:49.926043 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=24 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:50.443706 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0580e16-3ada-44da-8896-7b647f147cda None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:50.443982 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0580e16-3ada-44da-8896-7b647f147cda None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:50.444235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0580e16-3ada-44da-8896-7b647f147cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:50.463646 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e0580e16-3ada-44da-8896-7b647f147cda None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:50.464876 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e0580e16-3ada-44da-8896-7b647f147cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:50.472871 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1442/2883] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:50.497856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:50.511881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478a6ce-d8bb-4e33-b28f-9e5ec200fda4 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:50.517201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52655f-6487-459f-879c-6342ecb14463 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:50.517845 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52655f-6487-459f-879c-6342ecb14463 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:50.518130 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52655f-6487-459f-879c-6342ecb14463 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:50.518443 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52655f-6487-459f-879c-6342ecb14463 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:50.527869 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52655f-6487-459f-879c-6342ecb14463 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:50.529573 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52655f-6487-459f-879c-6342ecb14463 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:50.539253 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1442/2884] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:39:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:39:51.129536 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d707-512f-4907-b11a-9c74c131847b None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:51.130614 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d707-512f-4907-b11a-9c74c131847b None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:51.131747 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d707-512f-4907-b11a-9c74c131847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:51.158995 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-c125d707-512f-4907-b11a-9c74c131847b None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:51.161300 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c125d707-512f-4907-b11a-9c74c131847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:51.170235 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1443/2885] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jul 20 15:39:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:51.183335 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52655f-6487-459f-879c-6342ecb14463 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:51.194907 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52655f-6487-459f-879c-6342ecb14463 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:51.200510 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90670a-1dee-486e-ae5d-8587a4ef00b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:51.201171 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90670a-1dee-486e-ae5d-8587a4ef00b6 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:51.201621 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90670a-1dee-486e-ae5d-8587a4ef00b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:51.201904 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90670a-1dee-486e-ae5d-8587a4ef00b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:51.214420 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90670a-1dee-486e-ae5d-8587a4ef00b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:51.215499 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90670a-1dee-486e-ae5d-8587a4ef00b6 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:51.224767 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1443/2886] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:39:51.503823 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad666c-1042-4600-9ca8-53fdecf8b6eb None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:51.504116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad666c-1042-4600-9ca8-53fdecf8b6eb None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:51.504530 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad666c-1042-4600-9ca8-53fdecf8b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:51.529047 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-e6ad666c-1042-4600-9ca8-53fdecf8b6eb None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:51.530281 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-e6ad666c-1042-4600-9ca8-53fdecf8b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:51.544574 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1444/2887] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jul 20 15:39:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:51.561924 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90670a-1dee-486e-ae5d-8587a4ef00b6 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:51.576483 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90670a-1dee-486e-ae5d-8587a4ef00b6 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:51.582632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21c47b-04c2-4d98-ae67-32d995568152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:51.583407 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21c47b-04c2-4d98-ae67-32d995568152 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:51.583781 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21c47b-04c2-4d98-ae67-32d995568152 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:51.584118 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21c47b-04c2-4d98-ae67-32d995568152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:51.594432 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21c47b-04c2-4d98-ae67-32d995568152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:51.596678 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21c47b-04c2-4d98-ae67-32d995568152 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:51.608345 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1444/2888] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:39:52.004286 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6019-8d51-4736-876e-4a1097650b66 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:52.004573 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6019-8d51-4736-876e-4a1097650b66 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:52.004873 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6019-8d51-4736-876e-4a1097650b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:52.025378 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-ea9d6019-8d51-4736-876e-4a1097650b66 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:52.026619 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ea9d6019-8d51-4736-876e-4a1097650b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:52.035416 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1445/2889] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jul 20 15:39:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:52.051895 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21c47b-04c2-4d98-ae67-32d995568152 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:52.064277 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21c47b-04c2-4d98-ae67-32d995568152 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:52.070058 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8c25-d667-4600-b8b6-d9373bb6090b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:52.070784 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8c25-d667-4600-b8b6-d9373bb6090b service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:52.071108 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8c25-d667-4600-b8b6-d9373bb6090b service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:52.071489 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8c25-d667-4600-b8b6-d9373bb6090b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:52.081152 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a8c25-d667-4600-b8b6-d9373bb6090b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:52.082842 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a8c25-d667-4600-b8b6-d9373bb6090b service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:52.103025 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1445/2890] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:39:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:39:53.152588 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6019-8d51-4736-876e-4a1097650b66 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:53.154122 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-ea9d6019-8d51-4736-876e-4a1097650b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:53.166936 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6019-8d51-4736-876e-4a1097650b66 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:53.171191 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892baf5-35fd-41c4-aabd-97a9154ce233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:53.171870 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892baf5-35fd-41c4-aabd-97a9154ce233 service neutron] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:53.172147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892baf5-35fd-41c4-aabd-97a9154ce233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:53.172425 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892baf5-35fd-41c4-aabd-97a9154ce233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:53.174241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-c892baf5-35fd-41c4-aabd-97a9154ce233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:53.251219 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892baf5-35fd-41c4-aabd-97a9154ce233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:53.252980 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892baf5-35fd-41c4-aabd-97a9154ce233 service neutron] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:53.265836 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1446/2891] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:54.293287 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8c25-d667-4600-b8b6-d9373bb6090b service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:54.369569 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8c25-d667-4600-b8b6-d9373bb6090b service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:54.374412 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:54.375326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:54.375607 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:54.375876 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] PATH_INFO: `/v3/users/52aeb3628f4e47b1a5d0100feaded87d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:54.377107 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52aeb3628f4e47b1a5d0100feaded87d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:54.379086 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:54.443626 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52aeb3628f4e47b1a5d0100feaded87d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:54.457308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52aeb3628f4e47b1a5d0100feaded87d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:54.458038 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52aeb3628f4e47b1a5d0100feaded87d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:54.465386 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52aeb3628f4e47b1a5d0100feaded87d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:54.466164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52aeb3628f4e47b1a5d0100feaded87d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:54.482394 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1446/2892] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:54 2022] DELETE /identity/v3/users/52aeb3628f4e47b1a5d0100feaded87d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:54.487459 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb59fa-0f75-4c13-810f-424a54c8e734 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:54.488068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb59fa-0f75-4c13-810f-424a54c8e734 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:54.488068 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb59fa-0f75-4c13-810f-424a54c8e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:54.507310 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-15fb59fa-0f75-4c13-810f-424a54c8e734 None None] MFA Rules not processed for user `aa2794a5a2cb463787b9e7bc82103b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:54.508599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15fb59fa-0f75-4c13-810f-424a54c8e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:54.576949 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1447/2893] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jul 20 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:54.588002 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:54.589614 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:54.605069 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:54.655440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf80f-64b8-4c4f-8ede-845fa4887f44 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:54.659422 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3894e1d2983e4040a4b0ae92ce794f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:54.660098 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:54.660375 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:54.660632 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:54.672503 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:54.674004 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:54.685462 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1447/2894] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:54.877539 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb59fa-0f75-4c13-810f-424a54c8e734 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:54.879599 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-15fb59fa-0f75-4c13-810f-424a54c8e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:54.901125 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb59fa-0f75-4c13-810f-424a54c8e734 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:54.913278 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:54.914322 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:54.915103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:54.915103 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] PATH_INFO: `/v3/projects/bc2b763d8f844ad2b65ef2e874cdb926` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:54.916881 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2b763d8f844ad2b65ef2e874cdb926)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:54.919116 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:54.980076 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2b763d8f844ad2b65ef2e874cdb926', 'request_id': 'req-b30099ac-3fbf-4689-a9b7-311180f43566'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:54.990058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2b763d8f844ad2b65ef2e874cdb926', 'request_id': 'req-b30099ac-3fbf-4689-a9b7-311180f43566'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:54.995576 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:54.998160 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2b763d8f844ad2b65ef2e874cdb926', 'request_id': 'req-b30099ac-3fbf-4689-a9b7-311180f43566'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:55.014912 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] The token cache is being invalidate because project bc2b763d8f844ad2b65ef2e874cdb926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:55.015229 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:55.015868 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-b30099ac-3fbf-4689-a9b7-311180f43566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:55.017458 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1448/2895] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:54 2022] DELETE /identity/v3/projects/bc2b763d8f844ad2b65ef2e874cdb926 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:57.340884 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:57.343740 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:57.427870 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b28061-f81e-43cd-bd23-de49a8365a46 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:57.508641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29c52f8ffcc34046ac3ade9723bf8b89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:57.508641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:57.508641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:57.508641 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:57.510467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:57.529174 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:57.530861 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:57.544238 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1448/2896] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:40:05.011928 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=4 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:07.539024 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=82 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:15.940602 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace5d1-0622-475e-b2e6-24208b06e6a1 None None] REQUEST_METHOD: `POST` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:15.941147 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace5d1-0622-475e-b2e6-24208b06e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:15.941305 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace5d1-0622-475e-b2e6-24208b06e6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:15.964988 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.auth.core [None req-3cace5d1-0622-475e-b2e6-24208b06e6a1 None None] MFA Rules not processed for user `5cdab500d7854e69b13a16aa5946df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80224) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:15.966199 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3cace5d1-0622-475e-b2e6-24208b06e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:16.031136 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1449/2897] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jul 20 15:41:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:16.083929 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:16.085586 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:16.171833 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8488774-0055-4cb7-b834-c863b8e4f5a5 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:16.177326 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db8ce1a1d9143c491304d0b72ace736', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:16.177988 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:16.178275 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:16.178564 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:16.187468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:16.189072 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:16.198291 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1449/2898] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jul 20 15:41:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:41:20.100930 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cace5d1-0622-475e-b2e6-24208b06e6a1 None None] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:20.102632 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-3cace5d1-0622-475e-b2e6-24208b06e6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:20.190461 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cace5d1-0622-475e-b2e6-24208b06e6a1 None None] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:20.196451 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:20.197106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] REQUEST_METHOD: `GET` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:20.197413 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:20.197689 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:20.199718 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:20.213017 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:20.214757 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:20.225361 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1450/2899] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:23.409213 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:23.411268 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:23.508385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231d911-7296-4af0-9e4b-5aafda3adfda service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:23.513279 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:23.514258 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:23.514544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:23.514830 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] PATH_INFO: `/v3/users/0c4f1cfef86a41c3838e6edab19499e0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:23.516164 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4f1cfef86a41c3838e6edab19499e0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:23.518202 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:23.573779 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4f1cfef86a41c3838e6edab19499e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.587085 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4f1cfef86a41c3838e6edab19499e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.587856 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4f1cfef86a41c3838e6edab19499e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.597467 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4f1cfef86a41c3838e6edab19499e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.598395 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4f1cfef86a41c3838e6edab19499e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.615201 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1450/2900] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:23 2022] DELETE /identity/v3/users/0c4f1cfef86a41c3838e6edab19499e0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:23.818725 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:23.834551 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df1f9a-349a-49b3-8f97-a8a6edcf8426 service placement] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:23.896298 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:23.897161 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:23.897468 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:23.897740 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] PATH_INFO: `/v3/projects/8279e0d49a7d44cb86224e1d115fc7db` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:23.898934 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8279e0d49a7d44cb86224e1d115fc7db)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:23.900879 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:23.941668 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:23.957212 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8279e0d49a7d44cb86224e1d115fc7db', 'request_id': 'req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.964507 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8279e0d49a7d44cb86224e1d115fc7db', 'request_id': 'req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.970503 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8279e0d49a7d44cb86224e1d115fc7db', 'request_id': 'req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.981956 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] The token cache is being invalidate because project 8279e0d49a7d44cb86224e1d115fc7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:23.982241 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.982889 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:23.984521 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1451/2901] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:23 2022] DELETE /identity/v3/projects/8279e0d49a7d44cb86224e1d115fc7db => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:23.988530 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:23.990110 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:24.004362 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fc924-70b6-4adb-b650-27bddbdd1f68 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:24.009542 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:24.066754 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:24.067703 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:24.068106 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:24.068385 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] PATH_INFO: `/v3/users/65666c525a6144dba1297cce7c95892a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:24.069628 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65666c525a6144dba1297cce7c95892a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:24.071615 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:24.117263 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65666c525a6144dba1297cce7c95892a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.129792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65666c525a6144dba1297cce7c95892a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.130440 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65666c525a6144dba1297cce7c95892a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.137396 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65666c525a6144dba1297cce7c95892a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.138022 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65666c525a6144dba1297cce7c95892a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.150544 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1451/2902] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:23 2022] DELETE /identity/v3/users/65666c525a6144dba1297cce7c95892a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:24.332101 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] Authenticating user token {{(pid=80224) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:24.334316 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.fernet_utils [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80224) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:24.353106 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8d7ee-fa85-42f3-a61c-3d2f80865f27 admin admin] Validating token access rules against request {{(pid=80224) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:24.421353 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa2794a5a2cb463787b9e7bc82103b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5f14ce4f34142fb8d7bb6b7280eba0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80224) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:24.422220 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:24.422491 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:24.422724 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] PATH_INFO: `/v3/projects/d08f075e134f4713bdbee72d8053b8f7` {{(pid=80224) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:24.424011 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08f075e134f4713bdbee72d8053b8f7)` {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:24.425979 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] RBAC: Authorization granted {{(pid=80224) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:24.475785 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08f075e134f4713bdbee72d8053b8f7', 'request_id': 'req-c690510b-6eb4-473d-8502-c508847d35c1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.484656 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08f075e134f4713bdbee72d8053b8f7', 'request_id': 'req-c690510b-6eb4-473d-8502-c508847d35c1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.490770 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08f075e134f4713bdbee72d8053b8f7', 'request_id': 'req-c690510b-6eb4-473d-8502-c508847d35c1'} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.502938 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] The token cache is being invalidate because project d08f075e134f4713bdbee72d8053b8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80224) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:24.503265 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.504058 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG keystone.notifications [None req-c690510b-6eb4-473d-8502-c508847d35c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80224) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:24.505752 dv-cinder-848759-3-smb devstack@keystone.service[80224]: [pid: 80224|app: 0|req: 1452/2903] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:24 2022] DELETE /identity/v3/projects/d08f075e134f4713bdbee72d8053b8f7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:34.147139 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:34.499772 dv-cinder-848759-3-smb devstack@keystone.service[80224]: DEBUG dbcounter [-] [80224] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:46.521769 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:46.523468 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:46.616881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaacb53-792e-4e97-8cd4-7bb75ceddc54 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:46.698501 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5bba8-9c09-426c-9c3c-690de62567e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd510b41d234c96bb43fc1921c8604f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9625d8f2e12425f8aa9921ca7d5be50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:46.699301 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5bba8-9c09-426c-9c3c-690de62567e6 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:46.699601 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5bba8-9c09-426c-9c3c-690de62567e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:46.699881 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5bba8-9c09-426c-9c3c-690de62567e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:46.702262 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-92b5bba8-9c09-426c-9c3c-690de62567e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:46.717792 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5bba8-9c09-426c-9c3c-690de62567e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:46.719429 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5bba8-9c09-426c-9c3c-690de62567e6 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:46.730351 dv-cinder-848759-3-smb devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1452/2904] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:56.725308 dv-cinder-848759-3-smb devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=58 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}